[ 530.675426] env[65046]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 530.675426] env[65046]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 531.670152] env[65136]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 531.670152] env[65136]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 533.238980] env[65136]: INFO neutron.common.config [-] Logging enabled! [ 533.239439] env[65136]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 27.0.1.dev79 [ 533.239595] env[65136]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65136) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 533.239885] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 533.239985] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 533.240936] env[65136]: WARNING oslo_policy.policy [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 533.241076] env[65136]: WARNING oslo_policy.policy [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 533.242834] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] VMware NSXv3 Agent initialized successfully. [ 533.243213] env[65136]: DEBUG oslo_concurrency.lockutils [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] Acquiring lock "singleton_lock" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.243366] env[65136]: DEBUG oslo_concurrency.lockutils [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] Acquired lock "singleton_lock" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.243548] env[65136]: DEBUG oslo_concurrency.lockutils [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] Releasing lock "singleton_lock" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.243837] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] Full set of CONF: {{(pid=65136) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 533.243961] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ******************************************************************************** {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 533.244080] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] Configuration options gathered from: {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 533.244425] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 533.244594] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 533.244706] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ================================================================================ {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 533.244864] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] agent_down_time = 75 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.245014] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] allow_automatic_dhcp_failover = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.245149] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] allow_bulk = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.245309] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] api_extensions_path = {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.245465] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] api_paste_config = api-paste.ini {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.245607] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] auth_strategy = keystone {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.245718] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] backdoor_port = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.245806] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] backdoor_socket = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.245937] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] backlog = 4096 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.246089] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.246247] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] bind_host = 0.0.0.0 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.246387] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] bind_port = 9696 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.246522] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] client_socket_timeout = 900 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.246660] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] config_dir = [] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.246772] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.246898] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] config_source = [] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.247047] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] control_exchange = neutron {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.247188] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] core_plugin = ml2 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.247324] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] debug = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.247489] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] default_availability_zones = [] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.247712] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.247839] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] dhcp_agent_notification = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.248045] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] dhcp_agents_per_network = 1 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.248222] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] dhcp_lease_duration = 86400 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.248374] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] dhcp_load_type = networks {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.248537] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] dns_domain = openstacklocal {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.248691] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.248822] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] enable_default_route_bfd = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.248955] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] enable_default_route_ecmp = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.249096] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] enable_dvr = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.249229] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] enable_new_agents = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.249360] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.249491] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] enable_signals = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.249625] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] enable_traditional_dhcp = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.249755] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] external_dns_driver = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.249881] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] filter_validation = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.250097] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] global_physnet_mtu = 8950 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.250256] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] graceful_shutdown_timeout = 60 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.250467] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] host = cpu-1 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.250643] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] host_dvr_for_dhcp = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.250787] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] http_retries = 3 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.250933] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] instance_format = [instance: %(uuid)s] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.251085] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.251286] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ipam_driver = internal {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.251482] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ipv6_pd_enabled = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.251630] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] l3_ha = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.251863] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.251979] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] l3_ha_network_physical_name = {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.252078] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] l3_ha_network_type = {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.252269] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] log_color = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.252437] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] log_config_append = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.252581] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.252715] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] log_dir = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.252848] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] log_file = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.252959] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] log_options = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.253093] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] log_rotate_interval = 1 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.253235] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] log_rotate_interval_type = days {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.253372] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] log_rotation_type = none {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.253479] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.253593] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.253751] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.253889] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.253990] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.254136] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] max_dns_nameservers = 5 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.254267] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] max_header_line = 16384 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.254396] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] max_l3_agents_per_router = 3 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.254524] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] max_logfile_count = 30 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.254649] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] max_logfile_size_mb = 200 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.254773] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] max_subnet_host_routes = 20 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.254908] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] my_ip = 10.180.1.21 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.255048] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] my_ipv6 = ::1 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.255184] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] network_auto_schedule = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.255307] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] network_link_prefix = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.255444] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.255581] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] notify_nova_on_port_data_changes = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.255715] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] notify_nova_on_port_status_changes = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.255846] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] pagination_max_limit = -1 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.255972] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] publish_errors = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.256113] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] rate_limit_burst = 0 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.256248] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] rate_limit_except_level = CRITICAL {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.256378] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] rate_limit_interval = 0 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.256507] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] retry_until_window = 30 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.256631] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] router_distributed = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.256758] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] rpc_resources_processing_step = 20 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.256882] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] rpc_response_max_timeout = 600 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.257030] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] rpc_response_timeout = 60 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.257158] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] send_events_interval = 2 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.257291] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] service_plugins = ['router'] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.257469] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] setproctitle = on {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.257633] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] shell_completion = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.257777] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] state_path = /opt/stack/data/neutron {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.257913] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] syslog_log_facility = LOG_USER {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.258093] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] tcp_keepidle = 600 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.258256] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] transport_url = **** {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.258335] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] use_journal = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.258477] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] use_json = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.258596] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] use_ssl = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.258724] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] use_stderr = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.258860] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] use_syslog = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.258985] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] vlan_qinq = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.259122] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] vlan_transparent = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.259250] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] watch_log_file = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.259381] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] wsgi_default_pool_size = 100 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.259510] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] wsgi_keep_alive = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.259649] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.259810] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] wsgi_server_debug = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.259967] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_concurrency.disable_process_locking = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.260135] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.260339] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.260493] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.260642] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.260784] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.260922] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.261090] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] profiler.connection_string = messaging:// {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.261238] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] profiler.enabled = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.261383] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] profiler.es_doc_type = notification {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.261520] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] profiler.es_scroll_size = 10000 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.261662] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] profiler.es_scroll_time = 2m {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.261797] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] profiler.filter_error_trace = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.261989] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] profiler.hmac_keys = **** {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.262107] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] profiler.sentinel_service_name = mymaster {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.262236] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] profiler.socket_timeout = 0.1 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.262374] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] profiler.trace_requests = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.262511] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] profiler.trace_sqlalchemy = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.262661] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] profiler_jaeger.process_tags = {} {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.262795] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] profiler_jaeger.service_name_prefix = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.262929] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] profiler_otlp.service_name_prefix = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.263094] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_policy.enforce_new_defaults = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.263380] env[65136]: WARNING oslo_config.cfg [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 533.263534] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_policy.enforce_scope = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.263678] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_policy.policy_default_rule = default {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.263830] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.263971] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.264129] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.264261] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.264391] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.264521] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.264652] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.264814] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.265043] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.265214] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] agent.extensions = [] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.265371] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.265517] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] service_providers.service_provider = [] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.265662] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] QUOTAS.default_quota = -1 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.265808] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.265945] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] QUOTAS.quota_floatingip = 50 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.266097] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] QUOTAS.quota_network = 100 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.266235] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] QUOTAS.quota_port = 500 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.266398] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.266504] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] QUOTAS.quota_router = 10 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.266636] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] QUOTAS.quota_security_group = 10 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.266769] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.266902] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] QUOTAS.quota_subnet = 100 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.267042] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] QUOTAS.track_quota_usage = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.267196] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.267330] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep.group = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.267492] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep.helper_command = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.267636] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep.log_daemon_traceback = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.267775] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.267911] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep.thread_pool_size = 8 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.268054] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep.user = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.268198] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.268386] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_dhcp_release.group = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.268482] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_dhcp_release.helper_command = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.268616] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.268754] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.268887] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.269031] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_dhcp_release.user = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.269214] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.269293] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_ovs_vsctl.group = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.269551] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.269551] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.269695] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.269916] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.269974] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_ovs_vsctl.user = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.270115] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_namespace.capabilities = [21] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.270246] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_namespace.group = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.270378] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_namespace.helper_command = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.270514] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.270651] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.270786] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.270915] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_namespace.user = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.271062] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_conntrack.capabilities = [12] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.271193] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_conntrack.group = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.271321] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_conntrack.helper_command = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.271453] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.271592] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.271729] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.271850] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_conntrack.user = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.271988] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_link.capabilities = [12, 21] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.272157] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_link.group = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.272268] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_link.helper_command = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.272410] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_link.log_daemon_traceback = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.272560] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.272696] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_link.thread_pool_size = 8 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.272826] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] privsep_link.user = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.272979] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.273143] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.273283] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.continue_on_failed_promotions = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.273430] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.dscp = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.273578] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.dscp_inherit = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.273723] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.force_mp_to_policy = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.273856] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.locking_coordinator_url = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.274016] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.log_agent_heartbeats = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.274163] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.logging_expire = 1 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.274307] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.274445] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.274592] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.polling_interval = 240 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.274727] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.274868] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.275015] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.report_interval = 30.0 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.275164] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.275344] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.275500] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.275646] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.sync_skew = 60 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.275784] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.synchronization_queue_size = 20 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.275920] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT.use_helper_for_ns_read = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.276075] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] SECURITYGROUP.enable_ipset = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.276222] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] SECURITYGROUP.enable_security_group = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.276365] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.276510] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.276656] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] experimental.ipv6_pd_enabled = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.276818] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ml2.extension_drivers = ['port_security'] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.276952] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ml2.external_network_type = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.277117] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.277262] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ml2.overlay_ip_version = 4 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.277425] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ml2.path_mtu = 8950 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.277575] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ml2.physical_network_mtus = {} {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.277724] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.277865] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.278018] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ml2.type_drivers = ['vlan'] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.278168] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.278307] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.278469] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.278622] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.278767] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.278907] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.279063] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.279207] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.279347] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.279549] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.279705] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_login_password = **** {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.279849] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.279989] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_login_user = admin {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.280147] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.280289] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.280426] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.280565] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.280713] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.280849] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.280989] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.281147] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.281285] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.281427] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.281573] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.281710] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.281851] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.282056] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.282298] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.282351] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.282480] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.282622] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] nova.auth_section = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.282769] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] nova.auth_type = password {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.282910] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.283055] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] nova.certfile = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.283195] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] nova.collect_timing = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.283339] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] nova.endpoint_type = public {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.283474] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] nova.insecure = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.283607] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] nova.keyfile = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.283750] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] nova.region_name = RegionOne {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.283885] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] nova.split_loggers = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.284021] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] nova.timeout = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.284161] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] placement.auth_section = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.284305] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] placement.auth_type = password {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.284443] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.284576] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] placement.certfile = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.284711] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] placement.collect_timing = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.284853] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] placement.endpoint_type = public {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.284986] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] placement.insecure = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.285129] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] placement.keyfile = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.285290] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] placement.region_name = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.285401] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] placement.split_loggers = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.285530] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] placement.timeout = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.285667] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.auth_section = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.285802] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.auth_type = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.285932] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.cafile = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.286072] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.certfile = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.286209] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.collect_timing = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.286342] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.connect_retries = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.286473] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.connect_retry_delay = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.286606] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.enable_notifications = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.286735] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.endpoint_override = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.286868] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.insecure = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.286998] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.interface = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.287141] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.keyfile = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.287276] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.max_version = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.287431] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.min_version = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.287572] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.region_name = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.287707] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.retriable_status_codes = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.287836] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.service_name = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.287964] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.service_type = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.288110] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.split_loggers = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.288240] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.status_code_retries = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.288378] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.status_code_retry_delay = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.288518] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.timeout = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.288653] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.valid_interfaces = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.288783] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ironic.version = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.288926] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] cli_script.dry_run = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.289085] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.289223] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.289358] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.289493] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.289628] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.289762] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.289893] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.290032] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.290168] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.290312] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.290447] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.290592] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.290732] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.290939] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.291116] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.291266] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.291404] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.291547] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.291684] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.291815] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.291945] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.292086] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.292220] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.292448] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.292499] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.292604] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.292737] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.292867] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.292998] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.293144] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.293277] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.ssl = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.293418] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.293557] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.293698] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.293865] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.294016] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.294157] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.294299] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_notifications.driver = [] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.294434] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_notifications.retry = -1 {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.294593] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.294721] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.295215] env[65136]: DEBUG oslo_service.backend._eventlet.service [None req-67c226bd-b275-4fdf-a5f8-4dcf37f0eeb2 None None] ******************************************************************************** {{(pid=65136) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 533.295988] env[65136]: DEBUG neutron.agent.securitygroups_rpc [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Init firewall settings (driver=nsxv3) {{(pid=65136) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 533.297339] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65136) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 533.297608] env[65136]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] RPC agent_id: nsxm-l-01a.corp.local [ 533.299882] env[65136]: DEBUG dogpile.cache.region [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 533.299998] env[65136]: DEBUG dogpile.lock [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 533.300105] env[65136]: DEBUG dogpile.lock [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 533.300196] env[65136]: DEBUG dogpile.lock [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 533.300289] env[65136]: DEBUG dogpile.cache.region [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 533.300377] env[65136]: DEBUG dogpile.lock [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 533.300503] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 533.333580] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Session token - acquiring [ 533.334998] env[65136]: DEBUG networking_nsxv3.common.locking [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.335194] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.335297] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.335745] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.347840] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.630677] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 533.652208] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 533.652420] env[65136]: DEBUG dogpile.cache.region [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Cache value generated in 0.352 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 533.652476] env[65136]: DEBUG dogpile.lock [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 533.652590] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Activating Policy API Provider. [ 533.652778] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Looking for the default Infrastructure Rules. [ 533.720773] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Looking for the Default Layer3 Logged Drop Section. [ 533.737416] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 533.737880] env[65136]: DEBUG networking_nsxv3.common.locking [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.738066] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquiring lock "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.738170] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired lock "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.738498] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired external semaphore "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.738852] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 534.254598] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 534.757254] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 535.259932] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Inventory metadata is going to be refreshed. [ 535.260419] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 536.075702] env[65136]: DEBUG networking_nsxv3.common.locking [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.076069] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.076069] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.076379] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.089505] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 536.090555] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.091195] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 536.108964] env[65136]: DEBUG networking_nsxv3.common.locking [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.109288] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.109288] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.109556] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.109680] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.109826] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 536.109939] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 536.110057] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 536.130847] env[65136]: DEBUG networking_nsxv3.common.locking [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.131212] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.131331] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.131590] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.131768] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.131916] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 536.152798] env[65136]: DEBUG networking_nsxv3.common.locking [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.153134] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.153134] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.153383] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.153529] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.153673] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 536.176172] env[65136]: DEBUG networking_nsxv3.common.locking [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.176517] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquiring lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.176517] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.176741] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired external semaphore "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.176884] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Releasing lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.177047] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 536.177155] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 536.177261] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 536.195493] env[65136]: DEBUG networking_nsxv3.common.locking [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.195801] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquiring lock "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.195801] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired lock "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.196064] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired external semaphore "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.196193] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Releasing lock "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.196338] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 536.196442] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 536.196549] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 536.216854] env[65136]: DEBUG networking_nsxv3.common.locking [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.217202] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.217202] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.217461] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.217612] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.217748] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 536.217851] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 536.217951] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Inventory metadata have been refreshed. [ 536.218060] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Dryrun:True. Metadata refresh completed. [ 536.218177] env[65136]: DEBUG oslo_concurrency.lockutils [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Releasing lock "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.219989] env[65136]: INFO neutron.agent.agent_extensions_manager [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Loaded agent extensions: [] [ 536.220731] env[65136]: DEBUG neutron_lib.callbacks.manager [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65136) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 536.274882] env[65136]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] NSXv3 Agent Agent RPC Daemon Started! [ 536.275319] env[65136]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] NSXv3 Agent Agent loop - iteration:0 started [ 536.275319] env[65136]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] NSXv3 Agent Agent out of sync with plugin! [ 541.221967] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 541.222388] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 546.223175] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 546.223578] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 551.225040] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 551.225332] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 551.424585] env[65136]: INFO networking_nsxv3.common.synchronization [None req-7ad90516-2d4b-494e-af95-f87691e2e310 demo admin] Enqueued Resource ID: f7bb8397-74d3-496a-a401-88e7efa57b8c with Priority: HIGHEST for action security_group_rules [ 551.425105] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7bb8397-74d3-496a-a401-88e7efa57b8c with Priority: HIGHEST for action security_group_rules [ 551.425939] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7bb8397-74d3-496a-a401-88e7efa57b8c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.425939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7bb8397-74d3-496a-a401-88e7efa57b8c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.425939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7bb8397-74d3-496a-a401-88e7efa57b8c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.426194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7bb8397-74d3-496a-a401-88e7efa57b8c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.426194] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7bb8397-74d3-496a-a401-88e7efa57b8c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 551.949588] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.949588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.949588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.949588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.949588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.949588] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7bb8397-74d3-496a-a401-88e7efa57b8c already deleted. [ 551.949588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7bb8397-74d3-496a-a401-88e7efa57b8c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.427088] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 556.427088] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 561.427843] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 561.428103] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 566.429403] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 566.429768] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.430269] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 571.430720] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 576.430958] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 576.431290] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 578.224071] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.224417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.224417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.224523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.224739] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.727423] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.230610] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.732997] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 579.733128] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 580.525514] env[65136]: INFO networking_nsxv3.common.synchronization [None req-e16f4bb2-98f8-4d51-8f0c-10183cbc3688 None None] Enqueued Resource ID: dd587f3b-0536-4afe-98ac-d72daf57ed49 with Priority: HIGHEST for action port [ 580.526101] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd587f3b-0536-4afe-98ac-d72daf57ed49 with Priority: HIGHEST for action port [ 580.526422] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd587f3b-0536-4afe-98ac-d72daf57ed49 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.526538] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd587f3b-0536-4afe-98ac-d72daf57ed49" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.526614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd587f3b-0536-4afe-98ac-d72daf57ed49" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.526871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd587f3b-0536-4afe-98ac-d72daf57ed49" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.526953] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd587f3b-0536-4afe-98ac-d72daf57ed49',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.536841] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.537022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.537117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.537331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.554280] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 580.555182] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.556195] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 580.579503] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.581948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.581948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.581948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.581948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.581948] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 580.581948] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 580.581948] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 580.606102] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.606244] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.606319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.606529] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.606662] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.606807] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 580.630243] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.630380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.630452] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.630652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.630777] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.630864] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 580.652629] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.652783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.653723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.653723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.653723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.653723] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 580.653723] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 580.653723] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 580.672312] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.672438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.672475] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.673125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.673125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.673125] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 580.673125] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 580.673125] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 580.695308] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.695308] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.695308] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.695544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.695648] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.695773] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 580.695850] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 580.695919] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 580.695987] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 580.696076] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 580.696138] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 580.696198] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 580.696474] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 580.696538] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 580.696609] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 580.718406] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.718406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.718406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.718406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.718406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.718406] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 580.742253] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.742425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.742521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.743351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.743351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.759062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.029711] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd587f3b-0536-4afe-98ac-d72daf57ed49 [ 581.032348] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.032548] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.032594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.032967] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.033146] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.033259] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd587f3b-0536-4afe-98ac-d72daf57ed49 already deleted. [ 581.033377] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd587f3b-0536-4afe-98ac-d72daf57ed49" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.784379] env[65136]: INFO networking_nsxv3.common.synchronization [None req-8e9e67fb-00f5-4da1-98dd-38060876817f None None] Enqueued Resource ID: 87a29b35-dba3-49df-bd54-3a7174a11de4 with Priority: HIGHEST for action port [ 581.784608] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87a29b35-dba3-49df-bd54-3a7174a11de4 with Priority: HIGHEST for action port [ 581.785049] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-87a29b35-dba3-49df-bd54-3a7174a11de4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.785888] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87a29b35-dba3-49df-bd54-3a7174a11de4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.785888] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87a29b35-dba3-49df-bd54-3a7174a11de4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.785888] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87a29b35-dba3-49df-bd54-3a7174a11de4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.785888] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87a29b35-dba3-49df-bd54-3a7174a11de4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.097196] env[65136]: INFO networking_nsxv3.common.synchronization [None req-c3ce5a29-4767-460d-bc65-7bc0d83496f4 None None] Enqueued Resource ID: 4cbb6fae-d06e-49bf-8412-07e5eb5b778e with Priority: HIGHEST for action port [ 582.097746] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cbb6fae-d06e-49bf-8412-07e5eb5b778e with Priority: HIGHEST for action port [ 582.099126] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cbb6fae-d06e-49bf-8412-07e5eb5b778e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.099303] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cbb6fae-d06e-49bf-8412-07e5eb5b778e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.099540] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cbb6fae-d06e-49bf-8412-07e5eb5b778e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.099594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cbb6fae-d06e-49bf-8412-07e5eb5b778e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.099658] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cbb6fae-d06e-49bf-8412-07e5eb5b778e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.288607] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87a29b35-dba3-49df-bd54-3a7174a11de4 [ 582.288947] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.289103] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.289171] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.289374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.289458] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.289550] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87a29b35-dba3-49df-bd54-3a7174a11de4 already deleted. [ 582.289632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87a29b35-dba3-49df-bd54-3a7174a11de4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.601764] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4cbb6fae-d06e-49bf-8412-07e5eb5b778e [ 582.602667] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.602667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.602667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.602667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.602667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.602667] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4cbb6fae-d06e-49bf-8412-07e5eb5b778e already deleted. [ 582.603075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cbb6fae-d06e-49bf-8412-07e5eb5b778e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.620723] env[65136]: INFO networking_nsxv3.common.synchronization [None req-fef8ea84-962f-4f83-abb5-a7eb417e31b3 None None] Enqueued Resource ID: 18c1fc47-753a-4cf5-9fe8-a06678f2c09b with Priority: HIGHEST for action port [ 583.621575] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c1fc47-753a-4cf5-9fe8-a06678f2c09b with Priority: HIGHEST for action port [ 583.623626] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-18c1fc47-753a-4cf5-9fe8-a06678f2c09b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.623626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18c1fc47-753a-4cf5-9fe8-a06678f2c09b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.623626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18c1fc47-753a-4cf5-9fe8-a06678f2c09b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.623626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18c1fc47-753a-4cf5-9fe8-a06678f2c09b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.623626] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18c1fc47-753a-4cf5-9fe8-a06678f2c09b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.126321] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18c1fc47-753a-4cf5-9fe8-a06678f2c09b [ 584.126321] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.126321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.126321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.126321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.126321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.126321] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18c1fc47-753a-4cf5-9fe8-a06678f2c09b already deleted. [ 584.126321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18c1fc47-753a-4cf5-9fe8-a06678f2c09b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.374265] env[65136]: INFO networking_nsxv3.common.synchronization [None req-89f4b3b5-b202-4d60-bbe8-a491d750ba09 None None] Enqueued Resource ID: 3e27ab63-62d3-4939-9012-4fa0ca990445 with Priority: HIGHEST for action port [ 584.374265] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e27ab63-62d3-4939-9012-4fa0ca990445 with Priority: HIGHEST for action port [ 584.374265] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e27ab63-62d3-4939-9012-4fa0ca990445 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.374265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e27ab63-62d3-4939-9012-4fa0ca990445" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.374883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e27ab63-62d3-4939-9012-4fa0ca990445" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.374883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e27ab63-62d3-4939-9012-4fa0ca990445" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.374883] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e27ab63-62d3-4939-9012-4fa0ca990445',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.557070] env[65136]: INFO networking_nsxv3.common.synchronization [None req-e5e20b99-2cd8-4dce-88c4-7409f3dff672 None None] Enqueued Resource ID: 0777bccf-d55c-4a27-9824-90edcdabb475 with Priority: HIGHEST for action port [ 584.559198] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0777bccf-d55c-4a27-9824-90edcdabb475 with Priority: HIGHEST for action port [ 584.559198] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-0777bccf-d55c-4a27-9824-90edcdabb475 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.559198] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0777bccf-d55c-4a27-9824-90edcdabb475" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.559198] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0777bccf-d55c-4a27-9824-90edcdabb475" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.559198] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0777bccf-d55c-4a27-9824-90edcdabb475" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.559198] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0777bccf-d55c-4a27-9824-90edcdabb475',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.879293] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e27ab63-62d3-4939-9012-4fa0ca990445 [ 584.879543] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.880036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.880036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.881605] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.881685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.882199] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e27ab63-62d3-4939-9012-4fa0ca990445 already deleted. [ 584.882343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e27ab63-62d3-4939-9012-4fa0ca990445" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.062008] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0777bccf-d55c-4a27-9824-90edcdabb475 [ 585.062373] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.062599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.062692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.064296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.064296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.064296] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0777bccf-d55c-4a27-9824-90edcdabb475 already deleted. [ 585.064296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0777bccf-d55c-4a27-9824-90edcdabb475" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.965023] env[65136]: INFO networking_nsxv3.common.synchronization [None req-3bc57b36-502c-4caa-90f4-4dd9ecc67c58 None None] Enqueued Resource ID: 3a05163d-053e-40fa-81d8-efec87412406 with Priority: HIGHEST for action port [ 586.965023] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a05163d-053e-40fa-81d8-efec87412406 with Priority: HIGHEST for action port [ 586.965023] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a05163d-053e-40fa-81d8-efec87412406 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.965023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a05163d-053e-40fa-81d8-efec87412406" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.965023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a05163d-053e-40fa-81d8-efec87412406" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.965023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a05163d-053e-40fa-81d8-efec87412406" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.965023] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a05163d-053e-40fa-81d8-efec87412406',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.467825] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a05163d-053e-40fa-81d8-efec87412406 [ 587.467825] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.467974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.467974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.468254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.468535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.468535] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a05163d-053e-40fa-81d8-efec87412406 already deleted. [ 587.468535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a05163d-053e-40fa-81d8-efec87412406" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.641957] env[65136]: INFO networking_nsxv3.common.synchronization [None req-41fa29cc-0bc6-4954-80ea-ca4a9d1d47f9 None None] Enqueued Resource ID: f13ff131-7586-4843-aa86-ff7c51a460bb with Priority: HIGHEST for action port [ 587.642255] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f13ff131-7586-4843-aa86-ff7c51a460bb with Priority: HIGHEST for action port [ 587.643010] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-f13ff131-7586-4843-aa86-ff7c51a460bb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.643139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f13ff131-7586-4843-aa86-ff7c51a460bb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.643206] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f13ff131-7586-4843-aa86-ff7c51a460bb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.643457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f13ff131-7586-4843-aa86-ff7c51a460bb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.643535] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f13ff131-7586-4843-aa86-ff7c51a460bb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.093790] env[65136]: INFO networking_nsxv3.common.synchronization [None req-b8ff9a53-61f6-4de5-9e3e-f048abd2414f None None] Enqueued Resource ID: 8621bd54-f059-4cfb-aec8-703432a31f82 with Priority: HIGHEST for action port [ 588.095105] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8621bd54-f059-4cfb-aec8-703432a31f82 with Priority: HIGHEST for action port [ 588.095105] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-8621bd54-f059-4cfb-aec8-703432a31f82 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.095105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8621bd54-f059-4cfb-aec8-703432a31f82" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.095105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8621bd54-f059-4cfb-aec8-703432a31f82" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.097664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8621bd54-f059-4cfb-aec8-703432a31f82" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.099042] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8621bd54-f059-4cfb-aec8-703432a31f82',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.146031] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f13ff131-7586-4843-aa86-ff7c51a460bb [ 588.146269] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.146411] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.146466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.146675] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.146759] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.146849] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f13ff131-7586-4843-aa86-ff7c51a460bb already deleted. [ 588.147027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f13ff131-7586-4843-aa86-ff7c51a460bb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.601415] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8621bd54-f059-4cfb-aec8-703432a31f82 [ 588.601917] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.602329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.602499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.603236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.603236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.603236] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8621bd54-f059-4cfb-aec8-703432a31f82 already deleted. [ 588.603236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8621bd54-f059-4cfb-aec8-703432a31f82" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.258184] env[65136]: INFO networking_nsxv3.common.synchronization [None req-1f2a1994-895e-4da8-8846-3ec4f82f9bc0 None None] Enqueued Resource ID: da92f9ed-f369-4f43-80e1-05439050c04e with Priority: HIGHEST for action port [ 589.258184] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da92f9ed-f369-4f43-80e1-05439050c04e with Priority: HIGHEST for action port [ 589.258654] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-da92f9ed-f369-4f43-80e1-05439050c04e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.258750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da92f9ed-f369-4f43-80e1-05439050c04e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.258853] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da92f9ed-f369-4f43-80e1-05439050c04e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.259361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da92f9ed-f369-4f43-80e1-05439050c04e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.259452] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da92f9ed-f369-4f43-80e1-05439050c04e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.761783] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da92f9ed-f369-4f43-80e1-05439050c04e [ 589.763666] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.763880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.763957] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.764197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.764291] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.764393] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da92f9ed-f369-4f43-80e1-05439050c04e already deleted. [ 589.764478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da92f9ed-f369-4f43-80e1-05439050c04e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.225026] env[65136]: INFO networking_nsxv3.common.synchronization [None req-ccccbc97-3179-450b-a4c0-42252df1f22d None None] Enqueued Resource ID: bcf85a5f-a54c-4345-a0ed-441251f9b0a6 with Priority: HIGHEST for action port [ 590.225026] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcf85a5f-a54c-4345-a0ed-441251f9b0a6 with Priority: HIGHEST for action port [ 590.225494] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcf85a5f-a54c-4345-a0ed-441251f9b0a6 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.227030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcf85a5f-a54c-4345-a0ed-441251f9b0a6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.227030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcf85a5f-a54c-4345-a0ed-441251f9b0a6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.227030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcf85a5f-a54c-4345-a0ed-441251f9b0a6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.227030] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcf85a5f-a54c-4345-a0ed-441251f9b0a6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.562445] env[65136]: INFO networking_nsxv3.common.synchronization [None req-de42d7c6-a4b2-4963-b63f-79d5a66c1e54 None None] Enqueued Resource ID: d0b9b62c-9e4a-4c55-8802-115805f018c2 with Priority: HIGHEST for action port [ 590.562723] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b9b62c-9e4a-4c55-8802-115805f018c2 with Priority: HIGHEST for action port [ 590.563378] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0b9b62c-9e4a-4c55-8802-115805f018c2 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.563468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0b9b62c-9e4a-4c55-8802-115805f018c2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.563522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0b9b62c-9e4a-4c55-8802-115805f018c2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.563750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0b9b62c-9e4a-4c55-8802-115805f018c2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.563835] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0b9b62c-9e4a-4c55-8802-115805f018c2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.731558] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bcf85a5f-a54c-4345-a0ed-441251f9b0a6 [ 590.731698] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.731777] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.732391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.732391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.732391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.732391] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bcf85a5f-a54c-4345-a0ed-441251f9b0a6 already deleted. [ 590.732391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcf85a5f-a54c-4345-a0ed-441251f9b0a6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.065989] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0b9b62c-9e4a-4c55-8802-115805f018c2 [ 591.067127] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.067127] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.067127] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.067357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.067357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.067450] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0b9b62c-9e4a-4c55-8802-115805f018c2 already deleted. [ 591.067545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0b9b62c-9e4a-4c55-8802-115805f018c2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.872213] env[65136]: INFO networking_nsxv3.common.synchronization [None req-fd67b7bd-b670-4ebb-b5af-7607fe3ef47b None None] Enqueued Resource ID: 852b6463-a9e5-4dc0-bbf8-ed3437d1d249 with Priority: HIGHEST for action port [ 592.872746] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 852b6463-a9e5-4dc0-bbf8-ed3437d1d249 with Priority: HIGHEST for action port [ 592.873134] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-852b6463-a9e5-4dc0-bbf8-ed3437d1d249 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.873269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-852b6463-a9e5-4dc0-bbf8-ed3437d1d249" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.873269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-852b6463-a9e5-4dc0-bbf8-ed3437d1d249" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.874841] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-852b6463-a9e5-4dc0-bbf8-ed3437d1d249" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.874841] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('852b6463-a9e5-4dc0-bbf8-ed3437d1d249',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.377401] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 852b6463-a9e5-4dc0-bbf8-ed3437d1d249 [ 593.377401] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.377401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.377401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.377401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.377401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.377401] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:852b6463-a9e5-4dc0-bbf8-ed3437d1d249 already deleted. [ 593.377401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-852b6463-a9e5-4dc0-bbf8-ed3437d1d249" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.867450] env[65136]: INFO networking_nsxv3.common.synchronization [None req-7bf92419-4b80-4000-a8bd-5ff814f1cc4f None None] Enqueued Resource ID: 7cf4450c-ea83-4731-a11f-cfe6850e74c4 with Priority: HIGHEST for action port [ 593.867917] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cf4450c-ea83-4731-a11f-cfe6850e74c4 with Priority: HIGHEST for action port [ 593.868223] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cf4450c-ea83-4731-a11f-cfe6850e74c4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.868347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cf4450c-ea83-4731-a11f-cfe6850e74c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.868742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cf4450c-ea83-4731-a11f-cfe6850e74c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.868990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cf4450c-ea83-4731-a11f-cfe6850e74c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.869091] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cf4450c-ea83-4731-a11f-cfe6850e74c4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.924735] env[65136]: INFO networking_nsxv3.common.synchronization [req-88a22a96-6238-42f8-92e7-6577753b49b5 req-116512b1-1894-4bb1-af3c-32e81cadcc2c tempest-DeleteServersAdminTestJSON-1450577537 tempest-DeleteServersAdminTestJSON-1450577537-project-member] Enqueued Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_members [ 593.925141] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_members [ 593.925836] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c713a5b4-d91d-4c9c-8670-3e057521cf54 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.925900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.926134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.926241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.926403] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.926733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.926807] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.926965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.927081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.927154] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.258175] env[65136]: INFO networking_nsxv3.common.synchronization [None req-3c06857b-4b7f-4223-9bde-243baecb0460 None None] Enqueued Resource ID: 5797433f-d24c-4ef2-ac31-d7fa804adc38 with Priority: HIGHEST for action port [ 594.258175] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5797433f-d24c-4ef2-ac31-d7fa804adc38 with Priority: HIGHEST for action port [ 594.258175] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-5797433f-d24c-4ef2-ac31-d7fa804adc38 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.258511] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5797433f-d24c-4ef2-ac31-d7fa804adc38" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.258797] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5797433f-d24c-4ef2-ac31-d7fa804adc38" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.259654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5797433f-d24c-4ef2-ac31-d7fa804adc38" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.259654] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5797433f-d24c-4ef2-ac31-d7fa804adc38',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.372880] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cf4450c-ea83-4731-a11f-cfe6850e74c4 [ 594.372880] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.372880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.372880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.372880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.372880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.372880] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cf4450c-ea83-4731-a11f-cfe6850e74c4 already deleted. [ 594.372880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cf4450c-ea83-4731-a11f-cfe6850e74c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.429818] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.430117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.430681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.430681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.430681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.431675] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.431675] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.431675] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.431675] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.431675] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.431675] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 already deleted. [ 594.431675] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.761753] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5797433f-d24c-4ef2-ac31-d7fa804adc38 [ 594.761967] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.762119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.762188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.762434] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.762517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.762623] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5797433f-d24c-4ef2-ac31-d7fa804adc38 already deleted. [ 594.762702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5797433f-d24c-4ef2-ac31-d7fa804adc38" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.468653] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.469169] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.469169] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.469590] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.469967] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.470208] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.470383] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.470912] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.470912] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.471229] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.471493] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.471700] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.471896] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.472097] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.472300] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.472496] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.497050] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.497050] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 595.497399] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.497741] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.498151] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-47621da7-f269-4553-a52b-c083041c7b35 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.498452] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-47621da7-f269-4553-a52b-c083041c7b35" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.498724] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-47621da7-f269-4553-a52b-c083041c7b35" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.499535] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-47621da7-f269-4553-a52b-c083041c7b35" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.499535] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47621da7-f269-4553-a52b-c083041c7b35',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.625973] env[65136]: INFO networking_nsxv3.common.synchronization [None req-b5ea3e88-2a39-43e3-97de-65cfa3a6e2f6 None None] Enqueued Resource ID: 9f20a768-587d-4987-864e-f8c6b93b83e7 with Priority: HIGHEST for action port [ 595.626572] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f20a768-587d-4987-864e-f8c6b93b83e7 with Priority: HIGHEST for action port [ 595.627438] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f20a768-587d-4987-864e-f8c6b93b83e7 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.627438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f20a768-587d-4987-864e-f8c6b93b83e7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.627438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f20a768-587d-4987-864e-f8c6b93b83e7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.627628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f20a768-587d-4987-864e-f8c6b93b83e7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.627739] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f20a768-587d-4987-864e-f8c6b93b83e7',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.002218] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.002513] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.002660] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.002993] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.003211] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.003381] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 47621da7-f269-4553-a52b-c083041c7b35 not found, creating... [ 596.003763] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.004017] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.004098] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.004374] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.004732] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.005384] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.005697] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.005891] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.006290] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.006576] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.006717] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 47621da7-f269-4553-a52b-c083041c7b35 is going to be created. [ 596.040472] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.040472] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.040626] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.041036] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.041317] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.042317] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-47621da7-f269-4553-a52b-c083041c7b35" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.130435] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f20a768-587d-4987-864e-f8c6b93b83e7 [ 596.130774] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.130881] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.130945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.131227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.131359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.131482] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f20a768-587d-4987-864e-f8c6b93b83e7 already deleted. [ 596.131591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f20a768-587d-4987-864e-f8c6b93b83e7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.658453] env[65136]: INFO networking_nsxv3.common.synchronization [None req-19bded58-5943-4da2-862c-7eca9b03e522 None None] Enqueued Resource ID: fb6fd77a-25c9-49c7-be29-a9ad8eaf63f4 with Priority: HIGHEST for action port [ 596.659120] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb6fd77a-25c9-49c7-be29-a9ad8eaf63f4 with Priority: HIGHEST for action port [ 596.659316] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb6fd77a-25c9-49c7-be29-a9ad8eaf63f4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.659445] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb6fd77a-25c9-49c7-be29-a9ad8eaf63f4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.659514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb6fd77a-25c9-49c7-be29-a9ad8eaf63f4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.659756] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb6fd77a-25c9-49c7-be29-a9ad8eaf63f4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.659839] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb6fd77a-25c9-49c7-be29-a9ad8eaf63f4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.806024] env[65136]: INFO networking_nsxv3.common.synchronization [req-88a22a96-6238-42f8-92e7-6577753b49b5 req-0e116b09-6324-4874-9405-c54ae6d9fb22 service nova] Enqueued Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_rules [ 596.806024] env[65136]: INFO networking_nsxv3.common.synchronization [req-88a22a96-6238-42f8-92e7-6577753b49b5 req-0e116b09-6324-4874-9405-c54ae6d9fb22 service nova] Enqueued Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_members [ 596.806024] env[65136]: INFO networking_nsxv3.common.synchronization [req-88a22a96-6238-42f8-92e7-6577753b49b5 req-0e116b09-6324-4874-9405-c54ae6d9fb22 service nova] Enqueued Resource ID: 47621da7-f269-4553-a52b-c083041c7b35 with Priority: HIGHEST for action port [ 596.806024] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_rules [ 596.806024] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_members [ 596.806024] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47621da7-f269-4553-a52b-c083041c7b35 with Priority: HIGHEST for action port [ 596.807766] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c713a5b4-d91d-4c9c-8670-3e057521cf54 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.808048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.808206] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.808624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.808823] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.810372] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c713a5b4-d91d-4c9c-8670-3e057521cf54 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.811654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.811654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.811654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.811654] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.811654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.811654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.811654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.811654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.811654] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.812688] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-47621da7-f269-4553-a52b-c083041c7b35 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.812971] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47621da7-f269-4553-a52b-c083041c7b35" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.813448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47621da7-f269-4553-a52b-c083041c7b35" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.813704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47621da7-f269-4553-a52b-c083041c7b35" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.813883] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47621da7-f269-4553-a52b-c083041c7b35',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.162978] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb6fd77a-25c9-49c7-be29-a9ad8eaf63f4 [ 597.163232] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.163391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.163479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.163754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.163855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.163955] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb6fd77a-25c9-49c7-be29-a9ad8eaf63f4 already deleted. [ 597.164049] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb6fd77a-25c9-49c7-be29-a9ad8eaf63f4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.249921] env[65136]: INFO networking_nsxv3.common.synchronization [req-03068e04-c441-463d-80b5-69cb2f9f7fb2 req-ecf392f4-0d42-4d86-9174-f50c6e5a98ba tempest-ServerTagsTestJSON-659517285 tempest-ServerTagsTestJSON-659517285-project-member] Enqueued Resource ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 with Priority: HIGHEST for action security_group_members [ 597.250532] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 with Priority: HIGHEST for action security_group_members [ 597.250916] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4016a6d9-0970-467e-9687-5ce3a39e3775 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.251439] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.251579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.251916] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.252156] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.252321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.252440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.252662] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.252817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.253228] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4016a6d9-0970-467e-9687-5ce3a39e3775',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.311491] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c713a5b4-d91d-4c9c-8670-3e057521cf54 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.311631] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.318460] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.335709] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47621da7-f269-4553-a52b-c083041c7b35 with status ACTIVE [ 597.338735] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.338735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.338735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.338735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.338735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.338735] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.338735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.338735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.338735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.338735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.338735] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.338735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.338735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.338735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.338735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.338735] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47621da7-f269-4553-a52b-c083041c7b35 is going to be updated. [ 597.362941] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.362941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.362941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.363264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.363386] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.363617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47621da7-f269-4553-a52b-c083041c7b35" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.600502] env[65136]: INFO networking_nsxv3.common.synchronization [None req-a52427e4-9afe-44ed-af4a-91071de085bb None None] Enqueued Resource ID: 60a49272-c5ff-4d01-9d6a-5a10f752fa9e with Priority: HIGHEST for action port [ 597.600502] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60a49272-c5ff-4d01-9d6a-5a10f752fa9e with Priority: HIGHEST for action port [ 597.601413] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-60a49272-c5ff-4d01-9d6a-5a10f752fa9e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.601413] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60a49272-c5ff-4d01-9d6a-5a10f752fa9e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.601413] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60a49272-c5ff-4d01-9d6a-5a10f752fa9e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.601648] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60a49272-c5ff-4d01-9d6a-5a10f752fa9e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.601648] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60a49272-c5ff-4d01-9d6a-5a10f752fa9e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.755165] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.755440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.755662] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.756020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.756241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.756660] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.756796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.756867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.757051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.757134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.757230] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 already deleted. [ 597.757466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.822392] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.897779] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.897990] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-781" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.898209] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-781" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.898649] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-781" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.899019] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.899238] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.899448] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.899762] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.900091] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.900356] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.900542] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.900680] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.900811] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.900929] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.901056] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.901188] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 597.913397] env[65136]: INFO networking_nsxv3.common.synchronization [None req-99c01658-4d84-45d5-a1b1-346929db28d0 tempest-VolumesAssistedSnapshotsTest-1316243484 tempest-VolumesAssistedSnapshotsTest-1316243484-project-member] Enqueued Resource ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c with Priority: HIGHEST for action security_group_rules [ 597.914422] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c with Priority: HIGHEST for action security_group_rules [ 597.914626] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.914698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.914786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.915083] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.915170] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3db224c-b3c3-47ed-ae74-91d6ec4d268c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.920406] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 597.920574] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 597.920958] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 597.920958] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-781" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.921201] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-9584fdaf-1af3-4368-90d6-ea170b496f6e taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.921371] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-9584fdaf-1af3-4368-90d6-ea170b496f6e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.921482] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-9584fdaf-1af3-4368-90d6-ea170b496f6e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.921775] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-9584fdaf-1af3-4368-90d6-ea170b496f6e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.921982] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9584fdaf-1af3-4368-90d6-ea170b496f6e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.103760] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60a49272-c5ff-4d01-9d6a-5a10f752fa9e [ 598.105032] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.105032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.105032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.105032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.105032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.105032] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60a49272-c5ff-4d01-9d6a-5a10f752fa9e already deleted. [ 598.105032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60a49272-c5ff-4d01-9d6a-5a10f752fa9e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.327405] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.327775] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.327847] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.328078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.328171] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.328583] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 is going to be created. [ 598.358490] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.358649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.358713] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.358937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.359137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.369379] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 in Status: UNINITIALIZED for 2s [ 598.424262] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.424506] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.424588] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.424858] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.425032] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.425284] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 9584fdaf-1af3-4368-90d6-ea170b496f6e not found, creating... [ 598.425431] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.425584] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.425694] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.425907] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.426059] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.426335] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.426483] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.426594] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.426793] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.426923] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.427209] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 9584fdaf-1af3-4368-90d6-ea170b496f6e is going to be created. [ 598.436054] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.436054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.436238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.436293] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.436362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.436453] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c already deleted. [ 598.436533] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.455685] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.455928] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.456063] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.456337] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.456559] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.456772] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-9584fdaf-1af3-4368-90d6-ea170b496f6e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.559490] env[65136]: INFO networking_nsxv3.common.synchronization [None req-140a666a-903f-4fc9-bfb3-c22cd28676ab None None] Enqueued Resource ID: 3a3d7f64-858f-44fa-8066-1fd9779aa8e3 with Priority: HIGHEST for action port [ 598.560094] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a3d7f64-858f-44fa-8066-1fd9779aa8e3 with Priority: HIGHEST for action port [ 598.560403] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a3d7f64-858f-44fa-8066-1fd9779aa8e3 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.560556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a3d7f64-858f-44fa-8066-1fd9779aa8e3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.560611] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a3d7f64-858f-44fa-8066-1fd9779aa8e3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.561154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a3d7f64-858f-44fa-8066-1fd9779aa8e3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.561154] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a3d7f64-858f-44fa-8066-1fd9779aa8e3',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.063029] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a3d7f64-858f-44fa-8066-1fd9779aa8e3 [ 599.063029] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.063429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.063429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.063589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.063653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.063755] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a3d7f64-858f-44fa-8066-1fd9779aa8e3 already deleted. [ 599.063847] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a3d7f64-858f-44fa-8066-1fd9779aa8e3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.224341] env[65136]: INFO networking_nsxv3.common.synchronization [req-03068e04-c441-463d-80b5-69cb2f9f7fb2 req-1bbb52d3-5cdb-443a-978b-6ece70ce95ff service nova] Enqueued Resource ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 with Priority: HIGHEST for action security_group_rules [ 599.224672] env[65136]: INFO networking_nsxv3.common.synchronization [req-03068e04-c441-463d-80b5-69cb2f9f7fb2 req-1bbb52d3-5cdb-443a-978b-6ece70ce95ff service nova] Enqueued Resource ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 with Priority: HIGHEST for action security_group_members [ 599.224672] env[65136]: INFO networking_nsxv3.common.synchronization [req-03068e04-c441-463d-80b5-69cb2f9f7fb2 req-1bbb52d3-5cdb-443a-978b-6ece70ce95ff service nova] Enqueued Resource ID: 9584fdaf-1af3-4368-90d6-ea170b496f6e with Priority: HIGHEST for action port [ 599.224966] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 with Priority: HIGHEST for action security_group_rules [ 599.225027] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 with Priority: HIGHEST for action security_group_members [ 599.225110] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9584fdaf-1af3-4368-90d6-ea170b496f6e with Priority: HIGHEST for action port [ 599.225968] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4016a6d9-0970-467e-9687-5ce3a39e3775 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.225968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.226209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.227062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.227286] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4016a6d9-0970-467e-9687-5ce3a39e3775',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.231963] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4016a6d9-0970-467e-9687-5ce3a39e3775 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.231963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.231963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.231963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.231963] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.231963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.231963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.231963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.231963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.231963] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4016a6d9-0970-467e-9687-5ce3a39e3775',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.231963] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-9584fdaf-1af3-4368-90d6-ea170b496f6e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.231963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9584fdaf-1af3-4368-90d6-ea170b496f6e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.232903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9584fdaf-1af3-4368-90d6-ea170b496f6e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.233175] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9584fdaf-1af3-4368-90d6-ea170b496f6e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.234106] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9584fdaf-1af3-4368-90d6-ea170b496f6e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.277826] env[65136]: INFO networking_nsxv3.common.synchronization [None req-09aa82ca-8d9d-4d98-a6ee-964604a4a280 None None] Enqueued Resource ID: b807ffe2-6e7c-476c-91c2-945fdd8b8076 with Priority: HIGHEST for action port [ 599.278585] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b807ffe2-6e7c-476c-91c2-945fdd8b8076 with Priority: HIGHEST for action port [ 599.278986] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-b807ffe2-6e7c-476c-91c2-945fdd8b8076 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.280385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b807ffe2-6e7c-476c-91c2-945fdd8b8076" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.280385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b807ffe2-6e7c-476c-91c2-945fdd8b8076" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.280385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b807ffe2-6e7c-476c-91c2-945fdd8b8076" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.280385] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b807ffe2-6e7c-476c-91c2-945fdd8b8076',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.421543] env[65136]: INFO networking_nsxv3.common.synchronization [None req-e999428f-9171-4716-a7e4-8fad9f749fb8 tempest-VolumesAssistedSnapshotsTest-1316243484 tempest-VolumesAssistedSnapshotsTest-1316243484-project-member] Enqueued Resource ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c with Priority: HIGHEST for action security_group_rules [ 599.422552] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c with Priority: HIGHEST for action security_group_rules [ 599.422770] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.422898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.422958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.423186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.423258] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3db224c-b3c3-47ed-ae74-91d6ec4d268c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.653776] env[65136]: INFO networking_nsxv3.common.synchronization [req-16b2768d-a268-47c4-b25f-2ebb912f5e73 req-514456c7-4192-4b46-83e0-8779c73fb08a tempest-ImagesOneServerNegativeTestJSON-685255343 tempest-ImagesOneServerNegativeTestJSON-685255343-project-member] Enqueued Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 599.653776] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 599.653776] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.653776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.653776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.653776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.653776] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.653776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.653776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.653776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.654183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.654183] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.737880] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4016a6d9-0970-467e-9687-5ce3a39e3775 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.738529] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.738724] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4016a6d9-0970-467e-9687-5ce3a39e3775',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.747957] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9584fdaf-1af3-4368-90d6-ea170b496f6e with status ACTIVE [ 599.748413] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.748553] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.748619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.748860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.748948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.749152] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.749436] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.749436] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.749436] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.749756] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.749756] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.749838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.749838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.749975] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.750046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.750118] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9584fdaf-1af3-4368-90d6-ea170b496f6e is going to be updated. [ 599.782480] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b807ffe2-6e7c-476c-91c2-945fdd8b8076 [ 599.783202] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.783202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.783202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.783202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.783521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.783521] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b807ffe2-6e7c-476c-91c2-945fdd8b8076 already deleted. [ 599.783521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b807ffe2-6e7c-476c-91c2-945fdd8b8076" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.822193] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.822193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.822193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.822193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.822193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.823193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9584fdaf-1af3-4368-90d6-ea170b496f6e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.947139] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.947234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.947234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.947456] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.947550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.947689] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c already deleted. [ 599.947791] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.157956] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.158529] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.159844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.159844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.159844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.159844] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.159844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.159844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.159844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.159844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.159844] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b already deleted. [ 600.159844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.242040] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4016a6d9-0970-467e-9687-5ce3a39e3775',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.378652] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 in Status: SUCCESS [ 600.381783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.381783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.381783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.381783] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.381783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.381783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.381783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.381783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.381783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.381783] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.476150] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.476363] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-913" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.476485] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-913" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.476797] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-913" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.480406] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.480978] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.480978] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.481967] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.481967] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.481967] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.481967] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 600.481967] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 600.481967] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 600.482277] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.482277] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 600.482277] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.505116] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.505277] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 600.505409] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.505575] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-913" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.505892] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-e2e848ab-40d8-47dd-9927-b96040a81fee taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.506757] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-e2e848ab-40d8-47dd-9927-b96040a81fee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.506757] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-e2e848ab-40d8-47dd-9927-b96040a81fee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.506757] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-e2e848ab-40d8-47dd-9927-b96040a81fee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.506757] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2e848ab-40d8-47dd-9927-b96040a81fee',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.563394] env[65136]: INFO networking_nsxv3.common.synchronization [None req-d420792a-c683-4ec5-b799-4f3606b9c653 None None] Enqueued Resource ID: d4fa6bb4-6e43-4b0a-8c46-129148318a05 with Priority: HIGHEST for action port [ 600.563711] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4fa6bb4-6e43-4b0a-8c46-129148318a05 with Priority: HIGHEST for action port [ 600.564543] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4fa6bb4-6e43-4b0a-8c46-129148318a05 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.564543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4fa6bb4-6e43-4b0a-8c46-129148318a05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.564543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4fa6bb4-6e43-4b0a-8c46-129148318a05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.564814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4fa6bb4-6e43-4b0a-8c46-129148318a05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.564904] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4fa6bb4-6e43-4b0a-8c46-129148318a05',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.746544] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.746544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.746544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.746544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.746544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.746544] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 is going to be created. [ 600.770565] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.770759] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.770759] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.770995] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.771318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.785158] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 in Status: UNINITIALIZED for 2s [ 600.884629] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c713a5b4-d91d-4c9c-8670-3e057521cf54 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.884629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.884629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.884629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.884629] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.884945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.884945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.884945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.885213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.885213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.885327] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c713a5b4-d91d-4c9c-8670-3e057521cf54 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.885327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.885420] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.885496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.885706] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.885792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.885841] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.885942] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.886032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.886102] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.886197] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.010486] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.010719] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.010842] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.011140] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.011283] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.016021] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port e2e848ab-40d8-47dd-9927-b96040a81fee not found, creating... [ 601.020292] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.020292] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.020292] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.020292] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.020292] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.020292] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.020292] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.020292] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.020292] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.020292] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.020664] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: e2e848ab-40d8-47dd-9927-b96040a81fee is going to be created. [ 601.043610] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.043848] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.044156] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.044389] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.044638] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.044917] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-e2e848ab-40d8-47dd-9927-b96040a81fee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.066832] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d4fa6bb4-6e43-4b0a-8c46-129148318a05 [ 601.067196] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.067381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.067508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.067818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.067948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.068097] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d4fa6bb4-6e43-4b0a-8c46-129148318a05 already deleted. [ 601.068230] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4fa6bb4-6e43-4b0a-8c46-129148318a05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.388561] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c713a5b4-d91d-4c9c-8670-3e057521cf54: rpc.has_security_group_logging(os_id): False [ 601.408443] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.408605] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.408680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.408950] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.409054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.409271] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.409368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.409435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.409609] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.409708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.409914] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.410050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.410102] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.410214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.410289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.410554] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.410554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.410671] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.410749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.410825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.410909] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 is going to be created. [ 601.475035] env[65136]: INFO networking_nsxv3.common.synchronization [req-aba18efe-d921-4733-a82b-eb26a5fbc581 req-c30b3c56-d490-4ffc-a657-ea9d8baa0bb5 tempest-ServersAdminNegativeTestJSON-1000543325 tempest-ServersAdminNegativeTestJSON-1000543325-project-member] Enqueued Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_members [ 601.475863] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_members [ 601.475944] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-39322202-687d-409e-86ef-4870f36135e8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.477249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.477332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.480722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.480722] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.480722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.480722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.480722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.480722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.480722] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.480722] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.480722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.480722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.480722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.480722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.498040] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 in Status: IN_PROGRESS for 2s [ 601.687325] env[65136]: INFO networking_nsxv3.common.synchronization [None req-17fc1a95-4050-41ee-b7a3-15d9cdf871de tempest-ServerActionsTestJSON-513195432 tempest-ServerActionsTestJSON-513195432-project-member] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_rules [ 601.687871] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_rules [ 601.688492] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.688694] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.688756] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.688963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.689074] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.772918] env[65136]: INFO networking_nsxv3.common.synchronization [req-16b2768d-a268-47c4-b25f-2ebb912f5e73 req-c80f1f6c-02dd-4952-8007-cf997449b052 service nova] Enqueued Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_rules [ 601.772918] env[65136]: INFO networking_nsxv3.common.synchronization [req-16b2768d-a268-47c4-b25f-2ebb912f5e73 req-c80f1f6c-02dd-4952-8007-cf997449b052 service nova] Enqueued Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 601.773025] env[65136]: INFO networking_nsxv3.common.synchronization [req-16b2768d-a268-47c4-b25f-2ebb912f5e73 req-c80f1f6c-02dd-4952-8007-cf997449b052 service nova] Enqueued Resource ID: e2e848ab-40d8-47dd-9927-b96040a81fee with Priority: HIGHEST for action port [ 601.773259] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_rules [ 601.773386] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 601.773480] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2e848ab-40d8-47dd-9927-b96040a81fee with Priority: HIGHEST for action port [ 601.774407] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.774574] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.774647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.774939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.774976] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.777342] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.777458] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.777527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.777725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.778463] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.778573] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.778652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.778920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.779034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.779132] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.780575] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2e848ab-40d8-47dd-9927-b96040a81fee taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.780900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2e848ab-40d8-47dd-9927-b96040a81fee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.780989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2e848ab-40d8-47dd-9927-b96040a81fee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.781166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2e848ab-40d8-47dd-9927-b96040a81fee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.781255] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2e848ab-40d8-47dd-9927-b96040a81fee',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.983851] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.984040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.984040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.984339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.984431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.984623] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.984717] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.984796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.984947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.985030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.985307] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39322202-687d-409e-86ef-4870f36135e8 already deleted. [ 601.985307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.057324] env[65136]: INFO networking_nsxv3.common.synchronization [None req-bc641216-def8-43e2-bff7-46c13c7ff8bc tempest-ServerActionsTestJSON-513195432 tempest-ServerActionsTestJSON-513195432-project-member] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_rules [ 602.057738] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_rules [ 602.058157] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.058302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.102905] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.103147] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.103267] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.103546] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.103769] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.103915] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.104035] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.104232] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.104366] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.104561] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.104666] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.104769] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.104869] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.104968] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.105083] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.105207] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.122801] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.122973] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.123130] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.123298] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.123592] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-323afba9-e615-4b13-8516-0839bcbf7834 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.123752] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-323afba9-e615-4b13-8516-0839bcbf7834" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.123864] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-323afba9-e615-4b13-8516-0839bcbf7834" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.124185] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-323afba9-e615-4b13-8516-0839bcbf7834" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.124313] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('323afba9-e615-4b13-8516-0839bcbf7834',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.211636] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.211636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.211832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.212196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.212196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.212196] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c already deleted. [ 602.212196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.212351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.212461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.212514] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.235480] env[65136]: INFO networking_nsxv3.common.synchronization [None req-ab0971f9-90a6-464f-abce-dd840ecaac8f None None] Enqueued Resource ID: e5ad78ca-3a3a-4459-857a-93deb795bb61 with Priority: HIGHEST for action port [ 602.236707] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5ad78ca-3a3a-4459-857a-93deb795bb61 with Priority: HIGHEST for action port [ 602.236707] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5ad78ca-3a3a-4459-857a-93deb795bb61 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.236707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5ad78ca-3a3a-4459-857a-93deb795bb61" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.236707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5ad78ca-3a3a-4459-857a-93deb795bb61" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.236947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5ad78ca-3a3a-4459-857a-93deb795bb61" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.236947] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5ad78ca-3a3a-4459-857a-93deb795bb61',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.278955] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.279100] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.281533] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.283035] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2e848ab-40d8-47dd-9927-b96040a81fee with status ACTIVE [ 602.283035] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.283253] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.283253] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.284351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.284351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.284351] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.284351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.284351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.284351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.284351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.284351] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.284351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.284351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.284712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.284712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.284712] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2e848ab-40d8-47dd-9927-b96040a81fee is going to be updated. [ 602.315720] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.315903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.315941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.316161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.316296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.316471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2e848ab-40d8-47dd-9927-b96040a81fee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.626661] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.626958] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.627123] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.627420] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.627565] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.627751] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 323afba9-e615-4b13-8516-0839bcbf7834 not found, creating... [ 602.628039] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.628209] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.628325] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.628538] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.628669] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.628940] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.629129] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.629257] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.629459] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.629584] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.629716] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 323afba9-e615-4b13-8516-0839bcbf7834 is going to be created. [ 602.649848] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.650150] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.650283] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.650569] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.650853] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.651140] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-323afba9-e615-4b13-8516-0839bcbf7834" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.739864] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5ad78ca-3a3a-4459-857a-93deb795bb61 [ 602.740205] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.740371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.740647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.740735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.740792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.740880] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5ad78ca-3a3a-4459-857a-93deb795bb61 already deleted. [ 602.740974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5ad78ca-3a3a-4459-857a-93deb795bb61" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.743884] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.744053] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.744224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.744299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.744382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.744482] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c already deleted. [ 602.744561] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.783688] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.799599] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 in Status: SUCCESS [ 602.799808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.802613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.802878] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.803076] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.803226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.803305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.803423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.803687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.803687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.803687] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4016a6d9-0970-467e-9687-5ce3a39e3775',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.264718] env[65136]: INFO networking_nsxv3.common.synchronization [req-a77a5328-7bda-418f-877f-cf2662b6e0e4 req-52cc55b8-4ed5-458f-9dce-7fabec6372a4 tempest-MigrationsAdminTest-368591407 tempest-MigrationsAdminTest-368591407-project-member] Enqueued Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_members [ 603.265279] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_members [ 603.265785] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a04e899-b185-4f20-8eea-e0edb95feabb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.265966] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.266055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.266367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.266534] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.266636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.266722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.266947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.267076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.267192] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.286214] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.286364] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.286409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.286749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.286749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.287261] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b is going to be created. [ 603.306444] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4016a6d9-0970-467e-9687-5ce3a39e3775 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.306612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.306685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.306907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.307108] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.307212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.307280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.307463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.307551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.307642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.307866] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4016a6d9-0970-467e-9687-5ce3a39e3775 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.307959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.308031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.308180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.308319] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.308408] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.308469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.308604] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.308683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.308777] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.308864] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4016a6d9-0970-467e-9687-5ce3a39e3775',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.312106] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.312246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.312346] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.312536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.312722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.323321] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: UNINITIALIZED for 2s [ 603.512965] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 in Status: SUCCESS [ 603.512965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.661309] env[65136]: INFO networking_nsxv3.common.synchronization [req-aba18efe-d921-4733-a82b-eb26a5fbc581 req-a2d721dc-0c5e-43aa-a94f-37ffe359c50e service nova] Enqueued Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_rules [ 603.661309] env[65136]: INFO networking_nsxv3.common.synchronization [req-aba18efe-d921-4733-a82b-eb26a5fbc581 req-a2d721dc-0c5e-43aa-a94f-37ffe359c50e service nova] Enqueued Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_members [ 603.661309] env[65136]: INFO networking_nsxv3.common.synchronization [req-aba18efe-d921-4733-a82b-eb26a5fbc581 req-a2d721dc-0c5e-43aa-a94f-37ffe359c50e service nova] Enqueued Resource ID: 323afba9-e615-4b13-8516-0839bcbf7834 with Priority: HIGHEST for action port [ 603.661309] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_rules [ 603.661309] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_members [ 603.661309] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 323afba9-e615-4b13-8516-0839bcbf7834 with Priority: HIGHEST for action port [ 603.663694] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39322202-687d-409e-86ef-4870f36135e8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.663694] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.663694] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.663694] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.664055] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.666365] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-39322202-687d-409e-86ef-4870f36135e8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.666365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.666365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.666365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.666365] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.666365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.666365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.666365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.666365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.666365] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.667958] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-323afba9-e615-4b13-8516-0839bcbf7834 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.668081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-323afba9-e615-4b13-8516-0839bcbf7834" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.668132] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-323afba9-e615-4b13-8516-0839bcbf7834" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.668274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-323afba9-e615-4b13-8516-0839bcbf7834" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.668438] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('323afba9-e615-4b13-8516-0839bcbf7834',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.743019] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.743019] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.743019] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.743019] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.743019] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.743019] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.743942] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.747900] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.747900] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.747900] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.747900] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.747900] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.747900] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.747900] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.747900] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.747900] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.767850] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.767850] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.767850] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.767850] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.767850] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-73f51f18-f723-43bc-afb7-32945fc50dda taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.767850] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-73f51f18-f723-43bc-afb7-32945fc50dda" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.767850] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-73f51f18-f723-43bc-afb7-32945fc50dda" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.767850] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-73f51f18-f723-43bc-afb7-32945fc50dda" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.767850] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73f51f18-f723-43bc-afb7-32945fc50dda',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.772022] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.772022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.772022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.772022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.772022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.772022] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.772022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.772022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.772022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.773327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.773327] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a04e899-b185-4f20-8eea-e0edb95feabb already deleted. [ 603.773327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.813624] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4016a6d9-0970-467e-9687-5ce3a39e3775: rpc.has_security_group_logging(os_id): False [ 603.835027] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.835027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.835027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.835027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.835027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.835027] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.835027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.835027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.835027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.835027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.836046] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.837089] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.837247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.837810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.838131] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.838598] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.838940] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.839953] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.839953] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.839953] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.839953] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 is going to be created. [ 603.908217] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.908359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.908427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.908636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.908820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.919855] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 in Status: IN_PROGRESS for 2s [ 604.170623] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-39322202-687d-409e-86ef-4870f36135e8 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.170851] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.173400] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.175603] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 323afba9-e615-4b13-8516-0839bcbf7834 with status ACTIVE [ 604.175875] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.176010] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.176086] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.176296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.176390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.176568] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.176670] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.176735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.176883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.176960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.177149] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.177240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.177301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.178083] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.178205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.178301] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 323afba9-e615-4b13-8516-0839bcbf7834 is going to be updated. [ 604.200236] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.200443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.200443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.200647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.200760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.200954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-323afba9-e615-4b13-8516-0839bcbf7834" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.274957] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.275209] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.275409] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.275614] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.275772] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.275978] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 73f51f18-f723-43bc-afb7-32945fc50dda not found, creating... [ 604.276178] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.276347] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.276469] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.276785] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.276785] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.277087] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.277259] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.277371] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.277572] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.277730] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.277876] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 73f51f18-f723-43bc-afb7-32945fc50dda is going to be created. [ 604.321679] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.321891] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.321891] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.322249] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.322510] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.322783] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-73f51f18-f723-43bc-afb7-32945fc50dda" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.680178] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.146635] env[65136]: INFO networking_nsxv3.common.synchronization [req-a77a5328-7bda-418f-877f-cf2662b6e0e4 req-3378ddfb-9fcd-42fb-a9e5-eaacbb9692cf service nova] Enqueued Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_rules [ 605.146635] env[65136]: INFO networking_nsxv3.common.synchronization [req-a77a5328-7bda-418f-877f-cf2662b6e0e4 req-3378ddfb-9fcd-42fb-a9e5-eaacbb9692cf service nova] Enqueued Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_members [ 605.146635] env[65136]: INFO networking_nsxv3.common.synchronization [req-a77a5328-7bda-418f-877f-cf2662b6e0e4 req-3378ddfb-9fcd-42fb-a9e5-eaacbb9692cf service nova] Enqueued Resource ID: 73f51f18-f723-43bc-afb7-32945fc50dda with Priority: HIGHEST for action port [ 605.147317] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_rules [ 605.147452] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_members [ 605.147550] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73f51f18-f723-43bc-afb7-32945fc50dda with Priority: HIGHEST for action port [ 605.148046] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a04e899-b185-4f20-8eea-e0edb95feabb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.148262] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.148879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.148879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.148879] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.150024] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a04e899-b185-4f20-8eea-e0edb95feabb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.150164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.150231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.150455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.150677] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.150835] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.150942] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.153702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.153879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.154062] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.155654] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-73f51f18-f723-43bc-afb7-32945fc50dda taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.155839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73f51f18-f723-43bc-afb7-32945fc50dda" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.155974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73f51f18-f723-43bc-afb7-32945fc50dda" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.156259] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73f51f18-f723-43bc-afb7-32945fc50dda" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.156387] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73f51f18-f723-43bc-afb7-32945fc50dda',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.182674] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.182873] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.182923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.183164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.183277] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.183386] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39322202-687d-409e-86ef-4870f36135e8 is going to be created. [ 605.212109] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.212272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.212353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.212625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.212811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.223803] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39322202-687d-409e-86ef-4870f36135e8 in Status: UNINITIALIZED for 2s [ 605.340239] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: SUCCESS [ 605.340761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.340988] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.341473] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.341473] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.341668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.341734] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.341990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.342148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.342295] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.342451] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.563684] env[65136]: INFO networking_nsxv3.common.synchronization [None req-1862e5aa-7fd4-48b4-83ca-e0d65518e6ca tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a with Priority: HIGHEST for action security_group_rules [ 605.564615] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a with Priority: HIGHEST for action security_group_rules [ 605.564924] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.565317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.565317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.566084] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.566084] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b753815-728e-4ba2-a7f0-1eb90d70cc2a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.658744] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.660682] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a04e899-b185-4f20-8eea-e0edb95feabb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.660845] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.661473] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73f51f18-f723-43bc-afb7-32945fc50dda with status ACTIVE [ 605.661473] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.661473] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.661473] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.661867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.661867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.661979] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.662982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.662982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.662982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.662982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.662982] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.662982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.662982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.662982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.662982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.663417] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73f51f18-f723-43bc-afb7-32945fc50dda is going to be updated. [ 605.686073] env[65136]: INFO networking_nsxv3.common.synchronization [None req-294e3a45-21ef-499a-b227-c846ef4ad5ab tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a with Priority: HIGHEST for action security_group_rules [ 605.687284] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.687428] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.687621] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.687892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.688044] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.688207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73f51f18-f723-43bc-afb7-32945fc50dda" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.688877] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a with Priority: HIGHEST for action security_group_rules [ 605.689278] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.689438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.845694] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.845955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.846089] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.846427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.846720] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.846891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.847031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.847282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.847439] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.847604] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.847875] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.848070] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.848181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.848419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.848659] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.848821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.848939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.849187] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.850067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.850067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.850067] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.933268] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 in Status: SUCCESS [ 605.933506] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.093688] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.093890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.093929] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.094197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.094389] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.094530] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a already deleted. [ 606.094636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.094800] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.094996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.095133] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b753815-728e-4ba2-a7f0-1eb90d70cc2a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.165886] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.352894] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee57c421-9f97-4726-90f3-a34f9975cc5b: rpc.has_security_group_logging(os_id): False [ 606.375513] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.375685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.375752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.376019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.376110] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.376334] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.376448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.376508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.376627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.376718] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.376911] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.377085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.377085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.377197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.377264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.378394] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.378394] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.378947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.379152] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.379233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.379321] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b is going to be created. [ 606.435644] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.435644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.435644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.435846] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.436247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.447047] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: IN_PROGRESS for 2s [ 606.616832] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.617022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.617128] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.617390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.617572] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.617620] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a already deleted. [ 606.618155] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.669458] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.669604] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.669687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.669987] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.670081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.670181] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a04e899-b185-4f20-8eea-e0edb95feabb is going to be created. [ 606.702375] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.702703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.702703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.702796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.703473] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.714014] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a04e899-b185-4f20-8eea-e0edb95feabb in Status: UNINITIALIZED for 2s [ 607.236536] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39322202-687d-409e-86ef-4870f36135e8 in Status: SUCCESS [ 607.236536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.236536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.236536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.236536] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.238354] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.238487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.238687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.238805] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.238884] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.238953] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.742494] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-39322202-687d-409e-86ef-4870f36135e8 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.742871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.742871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.742988] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.743336] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.743591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.743674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.743869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.743961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.744070] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.744235] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-39322202-687d-409e-86ef-4870f36135e8 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.744335] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.744397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.744571] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.744689] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.744781] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.744842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.744983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.745148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.745236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.745330] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.247870] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39322202-687d-409e-86ef-4870f36135e8: rpc.has_security_group_logging(os_id): False [ 608.275931] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.277789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.277789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.277789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.277789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.277789] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.277789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.277789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.277789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.277789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.277789] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.277789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.277789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.277789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.277789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.278850] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.278850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.278850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.278850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.278850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.278850] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39322202-687d-409e-86ef-4870f36135e8 is going to be created. [ 608.361639] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.361811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.361888] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.362120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.362297] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.376148] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39322202-687d-409e-86ef-4870f36135e8 in Status: IN_PROGRESS for 2s [ 608.465946] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: SUCCESS [ 608.466226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.727509] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a04e899-b185-4f20-8eea-e0edb95feabb in Status: SUCCESS [ 608.727840] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.727952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.728228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.728417] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.728642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.728642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.729052] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.729052] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.729052] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.729052] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.123975] env[65136]: INFO networking_nsxv3.common.synchronization [req-8d0738f3-0dfd-4bf0-bdb5-3f2c1910aa45 req-ffd58ace-29cb-4421-b016-8445cab32ca5 tempest-AttachInterfacesV270Test-748732503 tempest-AttachInterfacesV270Test-748732503-project-member] Enqueued Resource ID: 2e54885c-f399-4f6d-8492-fac933ed5006 with Priority: HIGHEST for action security_group_members [ 609.126660] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e54885c-f399-4f6d-8492-fac933ed5006 with Priority: HIGHEST for action security_group_members [ 609.126660] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e54885c-f399-4f6d-8492-fac933ed5006 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.126660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.126660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.126660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.126660] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.126660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.126660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.126660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.126962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.127059] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e54885c-f399-4f6d-8492-fac933ed5006',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.235159] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a04e899-b185-4f20-8eea-e0edb95feabb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.235324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.235395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.235626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.235797] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.235893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.235953] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.236107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.236190] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.236274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.236425] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a04e899-b185-4f20-8eea-e0edb95feabb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.236517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.236578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.236717] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.236851] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.236951] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.236996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.237145] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.237221] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.237296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.238084] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.627743] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-897 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.627986] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-897" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.628114] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-897" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.628395] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-897" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.628664] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.628828] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.628936] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.629887] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.629887] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.629887] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.629887] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.629887] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.629887] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.629887] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.630260] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.630260] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.631490] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.631723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.631723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.631898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.631950] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.632362] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.633095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.633095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.633095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.633095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.633095] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e54885c-f399-4f6d-8492-fac933ed5006 already deleted. [ 609.633296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.655107] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.655107] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.655107] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.655107] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-897" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.655107] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-ce3bed59-4816-4652-9cb4-b6907728a644 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.655107] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-ce3bed59-4816-4652-9cb4-b6907728a644" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.655400] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-ce3bed59-4816-4652-9cb4-b6907728a644" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.655430] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-ce3bed59-4816-4652-9cb4-b6907728a644" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.655610] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce3bed59-4816-4652-9cb4-b6907728a644',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.741477] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a04e899-b185-4f20-8eea-e0edb95feabb: rpc.has_security_group_logging(os_id): False [ 609.759249] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.759415] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.759459] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.759680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.759770] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.760059] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.760165] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.760248] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.760387] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.760512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.760659] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.760749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.760798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.761545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.761545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.761545] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.761545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.761545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.761545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.761545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.761849] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a04e899-b185-4f20-8eea-e0edb95feabb is going to be created. [ 609.825943] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.826059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.828021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.828021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.828021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.837869] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a04e899-b185-4f20-8eea-e0edb95feabb in Status: IN_PROGRESS for 2s [ 610.158479] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.158841] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.158841] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.159116] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.159262] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.159403] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port ce3bed59-4816-4652-9cb4-b6907728a644 not found, creating... [ 610.159668] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.159836] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.159971] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.160198] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.160330] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.160598] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.160743] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.160855] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.161099] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.161229] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.161396] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: ce3bed59-4816-4652-9cb4-b6907728a644 is going to be created. [ 610.182885] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.183118] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.183294] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.183497] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.183712] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.183934] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-ce3bed59-4816-4652-9cb4-b6907728a644" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.387037] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39322202-687d-409e-86ef-4870f36135e8 in Status: SUCCESS [ 610.387280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.649827] env[65136]: INFO networking_nsxv3.common.synchronization [None req-72806bac-1931-4252-8f93-b6dc3105eaeb tempest-ServersWithSpecificFlavorTestJSON-92176410 tempest-ServersWithSpecificFlavorTestJSON-92176410-project-member] Enqueued Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_rules [ 610.650415] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_rules [ 610.650740] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.650857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.650933] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.651908] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.651996] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.945336] env[65136]: INFO networking_nsxv3.common.synchronization [req-8d0738f3-0dfd-4bf0-bdb5-3f2c1910aa45 req-1ce7557f-d7e7-4187-9843-8d8d1889942b service nova] Enqueued Resource ID: 2e54885c-f399-4f6d-8492-fac933ed5006 with Priority: HIGHEST for action security_group_rules [ 610.945336] env[65136]: INFO networking_nsxv3.common.synchronization [req-8d0738f3-0dfd-4bf0-bdb5-3f2c1910aa45 req-1ce7557f-d7e7-4187-9843-8d8d1889942b service nova] Enqueued Resource ID: 2e54885c-f399-4f6d-8492-fac933ed5006 with Priority: HIGHEST for action security_group_members [ 610.945336] env[65136]: INFO networking_nsxv3.common.synchronization [req-8d0738f3-0dfd-4bf0-bdb5-3f2c1910aa45 req-1ce7557f-d7e7-4187-9843-8d8d1889942b service nova] Enqueued Resource ID: ce3bed59-4816-4652-9cb4-b6907728a644 with Priority: HIGHEST for action port [ 610.945485] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e54885c-f399-4f6d-8492-fac933ed5006 with Priority: HIGHEST for action security_group_rules [ 610.945688] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e54885c-f399-4f6d-8492-fac933ed5006 with Priority: HIGHEST for action security_group_members [ 610.945688] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce3bed59-4816-4652-9cb4-b6907728a644 with Priority: HIGHEST for action port [ 610.946131] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e54885c-f399-4f6d-8492-fac933ed5006 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.946952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.946952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.947213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.947301] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e54885c-f399-4f6d-8492-fac933ed5006',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.948790] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e54885c-f399-4f6d-8492-fac933ed5006 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.948790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.948790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.948790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.949178] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.949178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.949178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.949178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.949305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.949335] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e54885c-f399-4f6d-8492-fac933ed5006',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.952174] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce3bed59-4816-4652-9cb4-b6907728a644 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.952174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce3bed59-4816-4652-9cb4-b6907728a644" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.952174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce3bed59-4816-4652-9cb4-b6907728a644" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.952893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce3bed59-4816-4652-9cb4-b6907728a644" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.952893] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce3bed59-4816-4652-9cb4-b6907728a644',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.174196] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.174485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.174485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.174609] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.174697] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.174790] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 already deleted. [ 611.174871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.249384] env[65136]: INFO networking_nsxv3.common.synchronization [None req-b15d5ac7-ec25-49ee-967b-954864e0d7eb tempest-ServersWithSpecificFlavorTestJSON-92176410 tempest-ServersWithSpecificFlavorTestJSON-92176410-project-member] Enqueued Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_rules [ 611.249794] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_rules [ 611.250360] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.250360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.250360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.250714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.250714] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.454069] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e54885c-f399-4f6d-8492-fac933ed5006 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.454256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.454541] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e54885c-f399-4f6d-8492-fac933ed5006',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.455450] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce3bed59-4816-4652-9cb4-b6907728a644 with status ACTIVE [ 611.455653] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.455805] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.455887] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.456247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.456247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.456391] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.456492] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.456555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.456765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.456879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.458176] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.458259] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.458385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.460058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.460058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.460058] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce3bed59-4816-4652-9cb4-b6907728a644 is going to be updated. [ 611.484856] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.485147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.485289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.485534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.485699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.485862] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce3bed59-4816-4652-9cb4-b6907728a644" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.770819] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.770939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.770939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.771194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.771323] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.771368] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 already deleted. [ 611.771469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.904332] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a04e899-b185-4f20-8eea-e0edb95feabb in Status: SUCCESS [ 611.904332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.963072] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e54885c-f399-4f6d-8492-fac933ed5006',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.183302] env[65136]: INFO networking_nsxv3.common.synchronization [req-5d9e10ec-f936-4bef-85d6-68b3f7baa7e6 req-38dbb15c-8486-4cc5-ab9c-ac0a0658169d tempest-ImagesOneServerTestJSON-1456813045 tempest-ImagesOneServerTestJSON-1456813045-project-member] Enqueued Resource ID: c9e25239-cb71-43b7-9bce-b16b700986d4 with Priority: HIGHEST for action security_group_members [ 612.183666] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9e25239-cb71-43b7-9bce-b16b700986d4 with Priority: HIGHEST for action security_group_members [ 612.185617] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9e25239-cb71-43b7-9bce-b16b700986d4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.185617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.185617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.185617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.185617] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.185617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.185617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.185617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.185617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.185617] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9e25239-cb71-43b7-9bce-b16b700986d4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.233689] env[65136]: INFO networking_nsxv3.common.synchronization [None req-e19a0660-7b7f-4c62-b4e3-f076b22b7478 None None] Enqueued Resource ID: a2bbd7ac-a86e-4cd8-926e-331b315da873 with Priority: HIGHEST for action port [ 612.233958] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2bbd7ac-a86e-4cd8-926e-331b315da873 with Priority: HIGHEST for action port [ 612.234354] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2bbd7ac-a86e-4cd8-926e-331b315da873 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.234499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2bbd7ac-a86e-4cd8-926e-331b315da873" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.234567] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2bbd7ac-a86e-4cd8-926e-331b315da873" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.234834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2bbd7ac-a86e-4cd8-926e-331b315da873" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.234916] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2bbd7ac-a86e-4cd8-926e-331b315da873',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.465277] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.465603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.465858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.466478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.466478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.466686] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e54885c-f399-4f6d-8492-fac933ed5006 is going to be created. [ 612.494911] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.495091] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.495091] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.495380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.495553] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.509365] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e54885c-f399-4f6d-8492-fac933ed5006 in Status: UNINITIALIZED for 2s [ 612.688277] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.688475] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.688514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.688767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.688971] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.689212] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.689383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.689472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.689655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.689738] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.689889] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9e25239-cb71-43b7-9bce-b16b700986d4 already deleted. [ 612.689984] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.741504] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2bbd7ac-a86e-4cd8-926e-331b315da873 [ 612.741748] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.741958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.742102] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.742368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.742463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.742579] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2bbd7ac-a86e-4cd8-926e-331b315da873 already deleted. [ 612.742684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2bbd7ac-a86e-4cd8-926e-331b315da873" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.913073] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-695 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.913073] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-695" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.913073] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-695" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.913352] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-695" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.913626] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.913764] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.913882] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.914119] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.914319] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.914810] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.914810] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.914810] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.914964] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.914964] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.915043] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.915170] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.936795] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.937743] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.937743] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.937743] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-695" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.937743] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-6363f181-2dfc-4467-bf10-4922e2db0fff taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.937998] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-6363f181-2dfc-4467-bf10-4922e2db0fff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.937998] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-6363f181-2dfc-4467-bf10-4922e2db0fff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.938336] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-6363f181-2dfc-4467-bf10-4922e2db0fff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.938506] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6363f181-2dfc-4467-bf10-4922e2db0fff',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.442659] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.442659] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.442659] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.442659] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.442659] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.442659] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 6363f181-2dfc-4467-bf10-4922e2db0fff not found, creating... [ 613.443072] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.443072] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.443072] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.443264] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.443406] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.443674] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.444304] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.444304] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.444534] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.444701] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.444843] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 6363f181-2dfc-4467-bf10-4922e2db0fff is going to be created. [ 613.465214] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.465425] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.465550] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.465816] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.466046] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.466261] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-6363f181-2dfc-4467-bf10-4922e2db0fff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.972053] env[65136]: INFO networking_nsxv3.common.synchronization [None req-db8d2ff9-4dfe-41b9-9e93-27f58bc683e6 None None] Enqueued Resource ID: 2fa09b8c-a4e8-4536-b9c3-1d940c18e58c with Priority: HIGHEST for action port [ 613.972053] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa09b8c-a4e8-4536-b9c3-1d940c18e58c with Priority: HIGHEST for action port [ 613.973115] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fa09b8c-a4e8-4536-b9c3-1d940c18e58c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.973115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fa09b8c-a4e8-4536-b9c3-1d940c18e58c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.973115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fa09b8c-a4e8-4536-b9c3-1d940c18e58c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.974031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fa09b8c-a4e8-4536-b9c3-1d940c18e58c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.974031] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fa09b8c-a4e8-4536-b9c3-1d940c18e58c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.345687] env[65136]: INFO networking_nsxv3.common.synchronization [req-5d9e10ec-f936-4bef-85d6-68b3f7baa7e6 req-6e9366d5-964a-485d-a7ab-af013660ed14 service nova] Enqueued Resource ID: c9e25239-cb71-43b7-9bce-b16b700986d4 with Priority: HIGHEST for action security_group_rules [ 614.346648] env[65136]: INFO networking_nsxv3.common.synchronization [req-5d9e10ec-f936-4bef-85d6-68b3f7baa7e6 req-6e9366d5-964a-485d-a7ab-af013660ed14 service nova] Enqueued Resource ID: c9e25239-cb71-43b7-9bce-b16b700986d4 with Priority: HIGHEST for action security_group_members [ 614.346648] env[65136]: INFO networking_nsxv3.common.synchronization [req-5d9e10ec-f936-4bef-85d6-68b3f7baa7e6 req-6e9366d5-964a-485d-a7ab-af013660ed14 service nova] Enqueued Resource ID: 6363f181-2dfc-4467-bf10-4922e2db0fff with Priority: HIGHEST for action port [ 614.347170] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9e25239-cb71-43b7-9bce-b16b700986d4 with Priority: HIGHEST for action security_group_rules [ 614.347308] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9e25239-cb71-43b7-9bce-b16b700986d4 with Priority: HIGHEST for action security_group_members [ 614.347308] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6363f181-2dfc-4467-bf10-4922e2db0fff with Priority: HIGHEST for action port [ 614.348176] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9e25239-cb71-43b7-9bce-b16b700986d4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.348176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.348176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.348176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.348176] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9e25239-cb71-43b7-9bce-b16b700986d4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.349536] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9e25239-cb71-43b7-9bce-b16b700986d4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.349536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.349536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.349782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.349782] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.350524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.350599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.350855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.350958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.351134] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9e25239-cb71-43b7-9bce-b16b700986d4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.353213] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-6363f181-2dfc-4467-bf10-4922e2db0fff taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.353344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6363f181-2dfc-4467-bf10-4922e2db0fff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.353406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6363f181-2dfc-4467-bf10-4922e2db0fff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.353593] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6363f181-2dfc-4467-bf10-4922e2db0fff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.353676] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6363f181-2dfc-4467-bf10-4922e2db0fff',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.477167] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fa09b8c-a4e8-4536-b9c3-1d940c18e58c [ 614.477167] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.477167] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.477520] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.477781] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.477781] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.477781] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fa09b8c-a4e8-4536-b9c3-1d940c18e58c already deleted. [ 614.477892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fa09b8c-a4e8-4536-b9c3-1d940c18e58c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.521363] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e54885c-f399-4f6d-8492-fac933ed5006 in Status: SUCCESS [ 614.521583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.521754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.522046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.522207] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.522302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.522373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.522574] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.522663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.522755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.522939] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e54885c-f399-4f6d-8492-fac933ed5006',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.854611] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c9e25239-cb71-43b7-9bce-b16b700986d4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.861243] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9e25239-cb71-43b7-9bce-b16b700986d4 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.861243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.861243] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6363f181-2dfc-4467-bf10-4922e2db0fff with status ACTIVE [ 614.861243] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.861243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.861243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.861243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.861243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.861243] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.861243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.861243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.861243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.862677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.863232] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.866015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.866015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.866015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.866015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.866015] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6363f181-2dfc-4467-bf10-4922e2db0fff is going to be updated. [ 614.889792] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.889792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.889792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.889792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.889792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.889792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6363f181-2dfc-4467-bf10-4922e2db0fff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.978033] env[65136]: INFO networking_nsxv3.common.synchronization [req-6f5d965a-656a-4d32-a5e3-cc001284375e req-d918ad85-f9e4-44fb-99ce-a69ade41e689 tempest-VolumesAssistedSnapshotsTest-1316243484 tempest-VolumesAssistedSnapshotsTest-1316243484-project-member] Enqueued Resource ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c with Priority: HIGHEST for action security_group_members [ 614.978033] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c with Priority: HIGHEST for action security_group_members [ 614.978639] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.979535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.982024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.982024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.982024] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.982024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.982024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.982024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.982024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.982024] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3db224c-b3c3-47ed-ae74-91d6ec4d268c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.025914] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e54885c-f399-4f6d-8492-fac933ed5006 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.028063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.028063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.028063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.028063] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.028063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.028063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.028063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.028063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.028063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.028063] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e54885c-f399-4f6d-8492-fac933ed5006 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.028063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.028063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.028954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.028954] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.028954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.028954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.028954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.028954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.029178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.029178] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e54885c-f399-4f6d-8492-fac933ed5006',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.366092] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c9e25239-cb71-43b7-9bce-b16b700986d4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.485724] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.485956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.485992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.486214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.486306] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.486501] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.486600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.486670] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.486820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.486896] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.486980] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c already deleted. [ 615.487074] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.531889] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e54885c-f399-4f6d-8492-fac933ed5006: rpc.has_security_group_logging(os_id): False [ 615.556204] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.556343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.556416] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.556627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.556833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.556931] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.557055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.557096] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.558460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.558588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.558864] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.559011] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.559118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.559242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.559325] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.559511] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.559607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.559830] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.560065] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.560171] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.560263] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e54885c-f399-4f6d-8492-fac933ed5006 is going to be created. [ 615.632206] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.632421] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.632421] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.632623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.632804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.643718] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e54885c-f399-4f6d-8492-fac933ed5006 in Status: IN_PROGRESS for 2s [ 615.735236] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-425 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.735353] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-425" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.735495] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-425" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.735962] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-425" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.736177] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.736333] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.736464] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.736688] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.736833] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.737052] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.737163] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.738421] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.738421] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.738421] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.738421] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.738421] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.763711] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.763711] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.763901] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.766066] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-425" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.766066] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-3bd6dec1-4125-4870-bbca-268abb2afb9e taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.766066] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-3bd6dec1-4125-4870-bbca-268abb2afb9e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.766066] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-3bd6dec1-4125-4870-bbca-268abb2afb9e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.766066] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-3bd6dec1-4125-4870-bbca-268abb2afb9e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.766066] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bd6dec1-4125-4870-bbca-268abb2afb9e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.868569] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.868788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.868902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.869216] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.869360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.869588] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9e25239-cb71-43b7-9bce-b16b700986d4 is going to be created. [ 615.897849] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.897849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.897849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.897849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.897849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.908312] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9e25239-cb71-43b7-9bce-b16b700986d4 in Status: UNINITIALIZED for 2s [ 616.131795] env[65136]: INFO networking_nsxv3.common.synchronization [None req-33148fbb-23f0-4352-82ca-f23eccb091ce None None] Enqueued Resource ID: 02576fb7-2c50-4fc4-a719-fe00d6590a4f with Priority: HIGHEST for action port [ 616.133315] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02576fb7-2c50-4fc4-a719-fe00d6590a4f with Priority: HIGHEST for action port [ 616.134119] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-02576fb7-2c50-4fc4-a719-fe00d6590a4f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.134119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02576fb7-2c50-4fc4-a719-fe00d6590a4f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.134119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02576fb7-2c50-4fc4-a719-fe00d6590a4f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.134417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02576fb7-2c50-4fc4-a719-fe00d6590a4f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.135265] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02576fb7-2c50-4fc4-a719-fe00d6590a4f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.270300] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.270958] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.270958] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.270958] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.272267] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.272267] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 3bd6dec1-4125-4870-bbca-268abb2afb9e not found, creating... [ 616.272267] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.272267] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.272267] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.272267] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.272553] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.272723] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.276021] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.276021] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.276021] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.276021] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.276021] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 3bd6dec1-4125-4870-bbca-268abb2afb9e is going to be created. [ 616.307508] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.307508] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.307508] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.308441] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.308441] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.308441] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-3bd6dec1-4125-4870-bbca-268abb2afb9e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.637132] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02576fb7-2c50-4fc4-a719-fe00d6590a4f [ 616.637548] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.637736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.637831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.638099] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.638277] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.638387] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02576fb7-2c50-4fc4-a719-fe00d6590a4f already deleted. [ 616.638520] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02576fb7-2c50-4fc4-a719-fe00d6590a4f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.054858] env[65136]: INFO networking_nsxv3.common.synchronization [req-6f5d965a-656a-4d32-a5e3-cc001284375e req-1e139b77-5209-41ed-8614-b8e7c36827ac service nova] Enqueued Resource ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c with Priority: HIGHEST for action security_group_rules [ 617.055165] env[65136]: INFO networking_nsxv3.common.synchronization [req-6f5d965a-656a-4d32-a5e3-cc001284375e req-1e139b77-5209-41ed-8614-b8e7c36827ac service nova] Enqueued Resource ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c with Priority: HIGHEST for action security_group_members [ 617.055223] env[65136]: INFO networking_nsxv3.common.synchronization [req-6f5d965a-656a-4d32-a5e3-cc001284375e req-1e139b77-5209-41ed-8614-b8e7c36827ac service nova] Enqueued Resource ID: 3bd6dec1-4125-4870-bbca-268abb2afb9e with Priority: HIGHEST for action port [ 617.055874] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c with Priority: HIGHEST for action security_group_rules [ 617.056063] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c with Priority: HIGHEST for action security_group_members [ 617.056794] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bd6dec1-4125-4870-bbca-268abb2afb9e with Priority: HIGHEST for action port [ 617.056794] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.056794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.056794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.058329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.058329] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3db224c-b3c3-47ed-ae74-91d6ec4d268c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.058329] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.058329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.058329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.058574] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.058907] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.058907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.058907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.059909] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.059909] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.059909] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3db224c-b3c3-47ed-ae74-91d6ec4d268c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.060633] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bd6dec1-4125-4870-bbca-268abb2afb9e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.060842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bd6dec1-4125-4870-bbca-268abb2afb9e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.060910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bd6dec1-4125-4870-bbca-268abb2afb9e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.061986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bd6dec1-4125-4870-bbca-268abb2afb9e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.061986] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bd6dec1-4125-4870-bbca-268abb2afb9e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.189182] env[65136]: INFO networking_nsxv3.common.synchronization [None req-49eb6bab-73fb-458c-a1ad-c6f5e453d764 None None] Enqueued Resource ID: b8b0faa9-9fa7-4f2d-bb30-aa834becf16d with Priority: HIGHEST for action port [ 617.189363] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8b0faa9-9fa7-4f2d-bb30-aa834becf16d with Priority: HIGHEST for action port [ 617.189962] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8b0faa9-9fa7-4f2d-bb30-aa834becf16d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.190111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8b0faa9-9fa7-4f2d-bb30-aa834becf16d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.190176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8b0faa9-9fa7-4f2d-bb30-aa834becf16d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.190429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8b0faa9-9fa7-4f2d-bb30-aa834becf16d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.190515] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8b0faa9-9fa7-4f2d-bb30-aa834becf16d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.567167] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3db224c-b3c3-47ed-ae74-91d6ec4d268c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.568856] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.568856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.568856] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bd6dec1-4125-4870-bbca-268abb2afb9e with status ACTIVE [ 617.568856] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.568856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.569826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.569826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.569826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.569826] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.569826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.569826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.569826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.569826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.570224] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.571262] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.572148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.572148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.572148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.572148] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bd6dec1-4125-4870-bbca-268abb2afb9e is going to be updated. [ 617.598491] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.598491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.598491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.598491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.598491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.598491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bd6dec1-4125-4870-bbca-268abb2afb9e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.658733] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e54885c-f399-4f6d-8492-fac933ed5006 in Status: SUCCESS [ 617.659033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.694463] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8b0faa9-9fa7-4f2d-bb30-aa834becf16d [ 617.694463] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.694463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.694463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.694463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.694463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.694747] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8b0faa9-9fa7-4f2d-bb30-aa834becf16d already deleted. [ 617.694747] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8b0faa9-9fa7-4f2d-bb30-aa834becf16d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.918236] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9e25239-cb71-43b7-9bce-b16b700986d4 in Status: SUCCESS [ 617.918463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.918894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.918894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.919082] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.919205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.919270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.919435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.919513] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.919599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.919690] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c9e25239-cb71-43b7-9bce-b16b700986d4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.073810] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3db224c-b3c3-47ed-ae74-91d6ec4d268c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.425632] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9e25239-cb71-43b7-9bce-b16b700986d4 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.425822] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.425899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.426140] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.427350] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.427350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.427350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.427350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.427350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.427350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.427350] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9e25239-cb71-43b7-9bce-b16b700986d4 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.427350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.427350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.427754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.427754] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.427754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.427885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.428042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.428042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.428145] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.428215] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c9e25239-cb71-43b7-9bce-b16b700986d4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.481758] env[65136]: INFO networking_nsxv3.common.synchronization [req-da901ed9-9512-42fa-9068-0dd66555b2f5 req-bb05a3fe-6ade-452c-8e64-ae39d1a89bce tempest-ServerActionsTestJSON-513195432 tempest-ServerActionsTestJSON-513195432-project-member] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 618.481758] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 618.481758] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.481758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.481758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.481758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.481758] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.481758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.481758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.481758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.481758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.481758] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.577638] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.578204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.578204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.578204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.578355] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.578391] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c is going to be created. [ 618.612672] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.612829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.612903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.613150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.613318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.634947] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c in Status: UNINITIALIZED for 2s [ 618.673777] env[65136]: INFO networking_nsxv3.common.synchronization [None req-041d9c43-cb2f-4825-a88f-5e982f006532 None None] Enqueued Resource ID: d8adc1de-804c-452b-9b89-a844f76b8db7 with Priority: HIGHEST for action port [ 618.674382] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8adc1de-804c-452b-9b89-a844f76b8db7 with Priority: HIGHEST for action port [ 618.675028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8adc1de-804c-452b-9b89-a844f76b8db7 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.675028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8adc1de-804c-452b-9b89-a844f76b8db7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.675028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8adc1de-804c-452b-9b89-a844f76b8db7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.676977] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8adc1de-804c-452b-9b89-a844f76b8db7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.677285] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8adc1de-804c-452b-9b89-a844f76b8db7',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.931919] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c9e25239-cb71-43b7-9bce-b16b700986d4: rpc.has_security_group_logging(os_id): False [ 618.952181] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.952729] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.952729] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.953151] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.953364] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.954229] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.954229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.954229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.954229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.954229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.955053] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.955053] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.955053] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.955053] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.955053] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.955053] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.955053] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.955969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.955969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.955969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.955969] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9e25239-cb71-43b7-9bce-b16b700986d4 is going to be created. [ 618.984080] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.984240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.984313] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.984845] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.984954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.985202] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.985311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.985372] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.985548] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.985658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.985803] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c already deleted. [ 618.985855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.992188] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-360 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.992388] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.992506] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.992826] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.993133] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.993496] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.993836] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.994864] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.994864] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.994864] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.994864] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.994864] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.994864] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.994864] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.995201] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.995201] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.014974] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.015100] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.015335] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.015335] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.015855] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-622ac4d8-cedc-404c-bb6b-59c8302d9404 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.015855] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-622ac4d8-cedc-404c-bb6b-59c8302d9404" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.016019] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-622ac4d8-cedc-404c-bb6b-59c8302d9404" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.016305] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-622ac4d8-cedc-404c-bb6b-59c8302d9404" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.016856] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('622ac4d8-cedc-404c-bb6b-59c8302d9404',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.025555] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.025732] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.026116] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.026116] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.026343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.039907] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9e25239-cb71-43b7-9bce-b16b700986d4 in Status: IN_PROGRESS for 2s [ 619.120945] env[65136]: INFO networking_nsxv3.common.synchronization [None req-097bf038-6c8c-4538-be84-c05bb1ebb138 None None] Enqueued Resource ID: aa7acafe-4c04-4372-9bc8-2250eee49d74 with Priority: HIGHEST for action port [ 619.122120] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7acafe-4c04-4372-9bc8-2250eee49d74 with Priority: HIGHEST for action port [ 619.122636] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa7acafe-4c04-4372-9bc8-2250eee49d74 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.123184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa7acafe-4c04-4372-9bc8-2250eee49d74" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.123184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa7acafe-4c04-4372-9bc8-2250eee49d74" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.123456] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa7acafe-4c04-4372-9bc8-2250eee49d74" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.123456] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa7acafe-4c04-4372-9bc8-2250eee49d74',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.181982] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d8adc1de-804c-452b-9b89-a844f76b8db7 [ 619.181982] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.181982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.182307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.182307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.182423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.182687] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d8adc1de-804c-452b-9b89-a844f76b8db7 already deleted. [ 619.182687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8adc1de-804c-452b-9b89-a844f76b8db7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.520848] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.521098] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.521221] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.521510] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.521652] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.521801] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 622ac4d8-cedc-404c-bb6b-59c8302d9404 not found, creating... [ 619.522071] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.522222] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.522330] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.522538] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.522666] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.522929] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.523092] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.523309] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.523947] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.523947] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.523947] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 622ac4d8-cedc-404c-bb6b-59c8302d9404 is going to be created. [ 619.559593] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.559975] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.559975] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.561566] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.561566] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.561566] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-622ac4d8-cedc-404c-bb6b-59c8302d9404" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.626368] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa7acafe-4c04-4372-9bc8-2250eee49d74 [ 619.626691] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.628267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.628267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.628267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.628267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.628267] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa7acafe-4c04-4372-9bc8-2250eee49d74 already deleted. [ 619.628267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa7acafe-4c04-4372-9bc8-2250eee49d74" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.297239] env[65136]: INFO networking_nsxv3.common.synchronization [req-da901ed9-9512-42fa-9068-0dd66555b2f5 req-a4c99ef9-f3dc-49d6-9a14-757f7454ddcb service nova] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_rules [ 620.297538] env[65136]: INFO networking_nsxv3.common.synchronization [req-da901ed9-9512-42fa-9068-0dd66555b2f5 req-a4c99ef9-f3dc-49d6-9a14-757f7454ddcb service nova] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 620.297760] env[65136]: INFO networking_nsxv3.common.synchronization [req-da901ed9-9512-42fa-9068-0dd66555b2f5 req-a4c99ef9-f3dc-49d6-9a14-757f7454ddcb service nova] Enqueued Resource ID: 622ac4d8-cedc-404c-bb6b-59c8302d9404 with Priority: HIGHEST for action port [ 620.298491] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_rules [ 620.298684] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 620.298831] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622ac4d8-cedc-404c-bb6b-59c8302d9404 with Priority: HIGHEST for action port [ 620.299249] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.299480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.299480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.299728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.300162] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.301021] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.301667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.301769] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.302032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.302240] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.302374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.302460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.302653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.302878] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.302878] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.304015] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-622ac4d8-cedc-404c-bb6b-59c8302d9404 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.304411] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-622ac4d8-cedc-404c-bb6b-59c8302d9404" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.304411] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-622ac4d8-cedc-404c-bb6b-59c8302d9404" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.304513] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-622ac4d8-cedc-404c-bb6b-59c8302d9404" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.304787] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('622ac4d8-cedc-404c-bb6b-59c8302d9404',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.527719] env[65136]: INFO networking_nsxv3.common.synchronization [req-2d1fbb62-eb41-4385-af66-d03fc38309ca req-c2fa1a42-055d-47de-af47-3514cce9e4ed tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a with Priority: HIGHEST for action security_group_members [ 620.528573] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a with Priority: HIGHEST for action security_group_members [ 620.528904] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.529074] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.529150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.529377] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.529558] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.529690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.529757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.529941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.530064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.530129] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b753815-728e-4ba2-a7f0-1eb90d70cc2a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.646770] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c in Status: SUCCESS [ 620.647402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.647587] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.647899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.648116] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.648606] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.648702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.648957] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.649099] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.649208] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.649879] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3db224c-b3c3-47ed-ae74-91d6ec4d268c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.806195] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.807373] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.807373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.807507] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 622ac4d8-cedc-404c-bb6b-59c8302d9404 with status ACTIVE [ 620.809137] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.809137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.809137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.809137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.809137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.809137] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.809137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.809137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.809137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.809137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.809137] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.809137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.809137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.810209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.810209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.810209] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 622ac4d8-cedc-404c-bb6b-59c8302d9404 is going to be updated. [ 620.812327] env[65136]: INFO networking_nsxv3.common.synchronization [None req-191fd0ae-333a-48c8-874c-7798785d1167 None None] Enqueued Resource ID: ea522cb7-0fb9-463c-947e-c9e1ecde292c with Priority: HIGHEST for action port [ 620.813167] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea522cb7-0fb9-463c-947e-c9e1ecde292c with Priority: HIGHEST for action port [ 620.813559] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea522cb7-0fb9-463c-947e-c9e1ecde292c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.813661] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea522cb7-0fb9-463c-947e-c9e1ecde292c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.813661] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea522cb7-0fb9-463c-947e-c9e1ecde292c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.814017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea522cb7-0fb9-463c-947e-c9e1ecde292c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.814017] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea522cb7-0fb9-463c-947e-c9e1ecde292c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.836440] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.836621] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.836720] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.836952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.837122] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.837291] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-622ac4d8-cedc-404c-bb6b-59c8302d9404" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.032494] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.032727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.032791] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.033644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.033770] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.034132] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.034256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.034420] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.038338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.038448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.038539] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a already deleted. [ 621.038629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.053193] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c9e25239-cb71-43b7-9bce-b16b700986d4 in Status: SUCCESS [ 621.053429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.153088] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3db224c-b3c3-47ed-ae74-91d6ec4d268c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.313146] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.315917] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea522cb7-0fb9-463c-947e-c9e1ecde292c [ 621.316164] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.316299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.316432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.316581] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.316667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.316859] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea522cb7-0fb9-463c-947e-c9e1ecde292c already deleted. [ 621.316859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea522cb7-0fb9-463c-947e-c9e1ecde292c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.565770] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-998 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.566106] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.566292] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.566612] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.566862] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.567090] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.567254] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.567520] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.567788] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.568079] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.568246] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.568409] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.568538] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.568688] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.568859] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.569052] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.588376] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.588652] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 621.588984] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.589289] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.589603] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-558d7525-a8c5-45a0-8fd4-e752734ee893 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.589778] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-558d7525-a8c5-45a0-8fd4-e752734ee893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.589937] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-558d7525-a8c5-45a0-8fd4-e752734ee893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.590290] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-558d7525-a8c5-45a0-8fd4-e752734ee893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.590468] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('558d7525-a8c5-45a0-8fd4-e752734ee893',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.654758] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3db224c-b3c3-47ed-ae74-91d6ec4d268c: rpc.has_security_group_logging(os_id): False [ 621.674089] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.674283] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.674328] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.676022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.676022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.676022] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.676022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.676022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.676022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.676022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.676022] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c is going to be created. [ 621.752347] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.752347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.752347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.752347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.752347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.791354] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c in Status: IN_PROGRESS for 2s [ 621.816993] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.817241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.817241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.817445] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.817597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.817709] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c is going to be created. [ 621.853829] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.854035] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.854116] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.854404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.854948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.867293] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: UNINITIALIZED for 2s [ 622.092551] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.092806] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.093079] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.093181] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.093325] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.093479] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 558d7525-a8c5-45a0-8fd4-e752734ee893 not found, creating... [ 622.093772] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.093996] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.094067] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.094324] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.094406] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.094640] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.094791] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.094900] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.095115] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.095406] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.095406] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 558d7525-a8c5-45a0-8fd4-e752734ee893 is going to be created. [ 622.118211] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.118459] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.118526] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.118779] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.119303] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.119303] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-558d7525-a8c5-45a0-8fd4-e752734ee893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.156500] env[65136]: INFO networking_nsxv3.common.synchronization [None req-7d036f79-849e-4f0f-b503-9b4fb612da59 None None] Enqueued Resource ID: 50f41252-40df-44a0-88d6-245830964d28 with Priority: HIGHEST for action port [ 622.157142] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f41252-40df-44a0-88d6-245830964d28 with Priority: HIGHEST for action port [ 622.157517] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-50f41252-40df-44a0-88d6-245830964d28 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.157671] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50f41252-40df-44a0-88d6-245830964d28" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.157800] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50f41252-40df-44a0-88d6-245830964d28" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.158080] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50f41252-40df-44a0-88d6-245830964d28" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.158160] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50f41252-40df-44a0-88d6-245830964d28',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.537072] env[65136]: INFO networking_nsxv3.common.synchronization [None req-74c2713a-06ed-46b2-8e16-76ae736b9c4d None None] Enqueued Resource ID: bdb949f5-43e5-4bf6-a555-181a77c0392a with Priority: HIGHEST for action port [ 622.537596] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdb949f5-43e5-4bf6-a555-181a77c0392a with Priority: HIGHEST for action port [ 622.537949] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdb949f5-43e5-4bf6-a555-181a77c0392a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.538080] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdb949f5-43e5-4bf6-a555-181a77c0392a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.538148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdb949f5-43e5-4bf6-a555-181a77c0392a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.538401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdb949f5-43e5-4bf6-a555-181a77c0392a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.538486] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdb949f5-43e5-4bf6-a555-181a77c0392a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.660527] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50f41252-40df-44a0-88d6-245830964d28 [ 622.660794] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.660928] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.661082] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.661313] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.661402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.661497] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50f41252-40df-44a0-88d6-245830964d28 already deleted. [ 622.661576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50f41252-40df-44a0-88d6-245830964d28" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.876067] env[65136]: INFO networking_nsxv3.common.synchronization [req-2d1fbb62-eb41-4385-af66-d03fc38309ca req-23f281c5-3b82-4e27-a265-f5711dce14d1 service nova] Enqueued Resource ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a with Priority: HIGHEST for action security_group_rules [ 622.876410] env[65136]: INFO networking_nsxv3.common.synchronization [req-2d1fbb62-eb41-4385-af66-d03fc38309ca req-23f281c5-3b82-4e27-a265-f5711dce14d1 service nova] Enqueued Resource ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a with Priority: HIGHEST for action security_group_members [ 622.876410] env[65136]: INFO networking_nsxv3.common.synchronization [req-2d1fbb62-eb41-4385-af66-d03fc38309ca req-23f281c5-3b82-4e27-a265-f5711dce14d1 service nova] Enqueued Resource ID: 558d7525-a8c5-45a0-8fd4-e752734ee893 with Priority: HIGHEST for action port [ 622.877605] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a with Priority: HIGHEST for action security_group_rules [ 622.877605] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a with Priority: HIGHEST for action security_group_members [ 622.877712] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 558d7525-a8c5-45a0-8fd4-e752734ee893 with Priority: HIGHEST for action port [ 622.878171] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.878333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.878367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.878608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.878758] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b753815-728e-4ba2-a7f0-1eb90d70cc2a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.880333] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.880571] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.880687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.883214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.885958] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.886555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.886622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.886864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.886952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.887076] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b753815-728e-4ba2-a7f0-1eb90d70cc2a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.888226] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-558d7525-a8c5-45a0-8fd4-e752734ee893 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.888444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-558d7525-a8c5-45a0-8fd4-e752734ee893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.888517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-558d7525-a8c5-45a0-8fd4-e752734ee893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.888711] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-558d7525-a8c5-45a0-8fd4-e752734ee893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.888832] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('558d7525-a8c5-45a0-8fd4-e752734ee893',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.046924] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bdb949f5-43e5-4bf6-a555-181a77c0392a [ 623.046924] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.046924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.046924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.046924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.046924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.046924] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bdb949f5-43e5-4bf6-a555-181a77c0392a already deleted. [ 623.046924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdb949f5-43e5-4bf6-a555-181a77c0392a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.395974] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 558d7525-a8c5-45a0-8fd4-e752734ee893 with status ACTIVE [ 623.395974] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.395974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.395974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.395974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.395974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.395974] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.395974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.395974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.395974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.395974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.395974] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.395974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.395974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.395974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.395974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.395974] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 558d7525-a8c5-45a0-8fd4-e752734ee893 is going to be updated. [ 623.398160] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b753815-728e-4ba2-a7f0-1eb90d70cc2a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.399100] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.399214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.424715] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.424715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.424715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.424715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.424887] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.425031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-558d7525-a8c5-45a0-8fd4-e752734ee893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.802984] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c in Status: SUCCESS [ 623.803366] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.877250] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: SUCCESS [ 623.877671] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.878016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.878379] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.878662] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.878836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.878893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.879033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.879116] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.879202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.879293] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.905642] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b753815-728e-4ba2-a7f0-1eb90d70cc2a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.382045] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.392361] env[65136]: INFO networking_nsxv3.common.synchronization [None req-45d2d5d0-c07b-4751-8c95-bf973e755b36 None None] Enqueued Resource ID: cc53a86e-2980-4d89-80e3-e3b4795df1a4 with Priority: HIGHEST for action port [ 624.393036] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc53a86e-2980-4d89-80e3-e3b4795df1a4 with Priority: HIGHEST for action port [ 624.395926] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc53a86e-2980-4d89-80e3-e3b4795df1a4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.395926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc53a86e-2980-4d89-80e3-e3b4795df1a4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.395926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc53a86e-2980-4d89-80e3-e3b4795df1a4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.396388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc53a86e-2980-4d89-80e3-e3b4795df1a4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.396558] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc53a86e-2980-4d89-80e3-e3b4795df1a4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.407045] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.407045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.407045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.407045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.407045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.407407] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a is going to be created. [ 624.437716] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.437955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.438113] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.438282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.438512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.451594] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a in Status: UNINITIALIZED for 2s [ 624.885500] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 341154f1-9b0b-43bc-8e74-163cf220f74c: rpc.has_security_group_logging(os_id): False [ 624.899625] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc53a86e-2980-4d89-80e3-e3b4795df1a4 [ 624.902992] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.902992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.902992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.902992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.902992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.902992] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc53a86e-2980-4d89-80e3-e3b4795df1a4 already deleted. [ 624.902992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc53a86e-2980-4d89-80e3-e3b4795df1a4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.912531] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.918168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.918168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.918168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.918168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.918168] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.918168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.918168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.918168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.918168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.918168] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c is going to be created. [ 624.994762] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.995015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.995015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.995790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.995790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.011177] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: IN_PROGRESS for 2s [ 625.934012] env[65136]: INFO networking_nsxv3.common.synchronization [req-f7ee226e-3213-43d1-9f5b-38a0b96d7abd req-10ccf573-aac7-4989-a73c-b3b0114821bd tempest-DeleteServersAdminTestJSON-1788304831 tempest-DeleteServersAdminTestJSON-1788304831-project-admin] Enqueued Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_members [ 625.934588] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_members [ 625.935051] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c713a5b4-d91d-4c9c-8670-3e057521cf54 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.935258] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.935321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.935567] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.935898] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.935898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.936034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.936170] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.936261] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.936359] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.441153] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.441852] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.442036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.442825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.442981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.443266] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.443428] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.443522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.443736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.443872] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.444015] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 is going to be updated. [ 626.464229] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a in Status: SUCCESS [ 626.464561] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.464812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.465149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.466593] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.466593] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.466593] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.466593] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.466593] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.466593] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.466593] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b753815-728e-4ba2-a7f0-1eb90d70cc2a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.479831] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.479978] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.480119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.480336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.480483] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.490588] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 in Status: IN_PROGRESS for 2s [ 626.969034] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b753815-728e-4ba2-a7f0-1eb90d70cc2a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.026579] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: SUCCESS [ 627.027079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.471172] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b753815-728e-4ba2-a7f0-1eb90d70cc2a: rpc.has_security_group_logging(os_id): False [ 627.494636] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.494867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.494965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.495211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.495307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.495651] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.495775] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.495827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.496023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.496108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.496208] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a is going to be created. [ 627.562174] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.562360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.562439] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.562651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.562894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.577506] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a in Status: IN_PROGRESS for 2s [ 628.366652] env[65136]: INFO networking_nsxv3.common.synchronization [req-bfae5f93-a30c-4882-a120-eb231b531555 req-326b4682-bce6-4430-986f-d22f894727d7 tempest-ServersWithSpecificFlavorTestJSON-92176410 tempest-ServersWithSpecificFlavorTestJSON-92176410-project-member] Enqueued Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_members [ 628.368552] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_members [ 628.369040] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.369216] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.370380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.370380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.370380] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.370380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.370380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.370380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.370380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.370380] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.502277] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 in Status: SUCCESS [ 628.502466] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 deletion is rescheduled due to dependency. [ 628.502578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.750288] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.750488] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.750613] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.750918] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.751213] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.752450] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.752450] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.752450] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.752450] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.752450] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.752450] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.752755] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.752755] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.752755] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.752836] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.752948] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.773328] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.773484] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 628.773629] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.773804] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.774157] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-83cca7eb-392b-4e1a-9591-9f005467e5b7 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.774325] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-83cca7eb-392b-4e1a-9591-9f005467e5b7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.774439] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-83cca7eb-392b-4e1a-9591-9f005467e5b7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.774738] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-83cca7eb-392b-4e1a-9591-9f005467e5b7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.774874] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83cca7eb-392b-4e1a-9591-9f005467e5b7',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.875491] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.875676] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.875752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.875970] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.876079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.876286] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.876383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.876446] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.876593] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.876667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.876750] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 already deleted. [ 628.876836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.277320] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.277502] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.277629] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.278024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.278192] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.278341] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 83cca7eb-392b-4e1a-9591-9f005467e5b7 not found, creating... [ 629.278590] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.278766] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.278907] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.279173] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.279308] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.279578] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.279730] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.279841] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.280172] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.280323] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.280461] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 83cca7eb-392b-4e1a-9591-9f005467e5b7 is going to be created. [ 629.301311] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.301498] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.301619] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.301872] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.302102] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.302336] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-83cca7eb-392b-4e1a-9591-9f005467e5b7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.595241] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a in Status: SUCCESS [ 629.595535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.060788] env[65136]: INFO networking_nsxv3.common.synchronization [req-bfae5f93-a30c-4882-a120-eb231b531555 req-ba42d684-9dcb-4244-8279-6d917505bfdc service nova] Enqueued Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_rules [ 630.060788] env[65136]: INFO networking_nsxv3.common.synchronization [req-bfae5f93-a30c-4882-a120-eb231b531555 req-ba42d684-9dcb-4244-8279-6d917505bfdc service nova] Enqueued Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_members [ 630.060788] env[65136]: INFO networking_nsxv3.common.synchronization [req-bfae5f93-a30c-4882-a120-eb231b531555 req-ba42d684-9dcb-4244-8279-6d917505bfdc service nova] Enqueued Resource ID: 83cca7eb-392b-4e1a-9591-9f005467e5b7 with Priority: HIGHEST for action port [ 630.060788] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_rules [ 630.060788] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_members [ 630.060788] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cca7eb-392b-4e1a-9591-9f005467e5b7 with Priority: HIGHEST for action port [ 630.067065] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.067065] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.067065] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.067065] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.067065] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.067496] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.071287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.071424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.071650] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.071856] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.071970] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.072046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.072227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.072317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.072411] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.077141] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-83cca7eb-392b-4e1a-9591-9f005467e5b7 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.077503] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83cca7eb-392b-4e1a-9591-9f005467e5b7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.077503] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83cca7eb-392b-4e1a-9591-9f005467e5b7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.079218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83cca7eb-392b-4e1a-9591-9f005467e5b7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.079218] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83cca7eb-392b-4e1a-9591-9f005467e5b7',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.579942] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.581269] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.581419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.581609] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83cca7eb-392b-4e1a-9591-9f005467e5b7 with status ACTIVE [ 630.581841] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.581966] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.582040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.582252] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.582343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.582536] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.582632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.582686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.582844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.582918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.584141] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.584303] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.584412] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.584646] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.584758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.584890] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83cca7eb-392b-4e1a-9591-9f005467e5b7 is going to be updated. [ 630.612530] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.613045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.613045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.613198] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.613268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.613450] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83cca7eb-392b-4e1a-9591-9f005467e5b7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.087686] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.593997] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.593997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.593997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.593997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.593997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.593997] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 is going to be created. [ 631.618792] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.619268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.619268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.619268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.621777] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.631112] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: UNINITIALIZED for 2s [ 633.142473] env[65136]: INFO networking_nsxv3.common.synchronization [req-1d744b12-a933-4dbd-b115-d08db5f3922e req-6127b042-5c92-4a6d-95ef-98e440b3a7e6 tempest-InstanceActionsV221TestJSON-434975811 tempest-InstanceActionsV221TestJSON-434975811-project-member] Enqueued Resource ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 with Priority: HIGHEST for action security_group_members [ 633.143310] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 with Priority: HIGHEST for action security_group_members [ 633.143310] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.143310] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.143310] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.143548] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.144180] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.144180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.144180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.144180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.146080] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.146197] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3377341-8fcc-4f3f-b4b7-a51279fee1e6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.529504] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.529789] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-740" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.530147] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-740" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.534053] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-740" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.534053] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.534053] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.534053] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.534053] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.534053] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.534053] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.534053] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.534053] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.534053] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.534053] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.534053] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.534053] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.557745] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.557745] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 633.557745] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.557745] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-740" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.557745] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-6bcf9f2d-e16a-4427-9c0d-5f8f302e847f taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.557745] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-6bcf9f2d-e16a-4427-9c0d-5f8f302e847f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.557745] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-6bcf9f2d-e16a-4427-9c0d-5f8f302e847f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.557745] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-6bcf9f2d-e16a-4427-9c0d-5f8f302e847f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.557745] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bcf9f2d-e16a-4427-9c0d-5f8f302e847f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.643103] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: SUCCESS [ 633.643240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.643440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.643664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.643887] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.644219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.644219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.644297] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.644385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.644524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.644592] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.648586] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.648731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.648797] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.649041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.649185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.649396] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.649520] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.649585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.649742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.649820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.649940] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 already deleted. [ 633.650107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.060717] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.061031] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.061127] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.061422] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.061588] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.061767] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 6bcf9f2d-e16a-4427-9c0d-5f8f302e847f not found, creating... [ 634.062072] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.062250] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.062406] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.062786] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.067208] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.067548] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.067753] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.067932] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.068183] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.068339] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.068486] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 6bcf9f2d-e16a-4427-9c0d-5f8f302e847f is going to be created. [ 634.091263] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.091511] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.091657] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.091947] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.092240] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.092500] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-6bcf9f2d-e16a-4427-9c0d-5f8f302e847f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.146898] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.650919] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4d6bec9-6ca7-4853-ab37-11ad5c3e2917: rpc.has_security_group_logging(os_id): False [ 634.671223] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.671438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.671438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.671687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.671851] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.673726] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.674498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.674498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.674498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.674498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.674498] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 is going to be created. [ 634.740371] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.740586] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.740586] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.740760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.740941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.755589] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: IN_PROGRESS for 2s [ 634.878555] env[65136]: INFO networking_nsxv3.common.synchronization [req-1d744b12-a933-4dbd-b115-d08db5f3922e req-d29aa4b0-3e27-46f5-aa21-9daf251ccbf2 service nova] Enqueued Resource ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 with Priority: HIGHEST for action security_group_rules [ 634.878824] env[65136]: INFO networking_nsxv3.common.synchronization [req-1d744b12-a933-4dbd-b115-d08db5f3922e req-d29aa4b0-3e27-46f5-aa21-9daf251ccbf2 service nova] Enqueued Resource ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 with Priority: HIGHEST for action security_group_members [ 634.879879] env[65136]: INFO networking_nsxv3.common.synchronization [req-1d744b12-a933-4dbd-b115-d08db5f3922e req-d29aa4b0-3e27-46f5-aa21-9daf251ccbf2 service nova] Enqueued Resource ID: 6bcf9f2d-e16a-4427-9c0d-5f8f302e847f with Priority: HIGHEST for action port [ 634.879879] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 with Priority: HIGHEST for action security_group_rules [ 634.879879] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 with Priority: HIGHEST for action security_group_members [ 634.879879] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bcf9f2d-e16a-4427-9c0d-5f8f302e847f with Priority: HIGHEST for action port [ 634.880134] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3377341-8fcc-4f3f-b4b7-a51279fee1e6 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.880134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.880316] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.880407] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.880488] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3377341-8fcc-4f3f-b4b7-a51279fee1e6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.881668] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.882431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.882431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.882431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.882431] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.882636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.882636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.882695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.884223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.884223] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3377341-8fcc-4f3f-b4b7-a51279fee1e6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.884223] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bcf9f2d-e16a-4427-9c0d-5f8f302e847f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.884223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bcf9f2d-e16a-4427-9c0d-5f8f302e847f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.884223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bcf9f2d-e16a-4427-9c0d-5f8f302e847f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.884419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bcf9f2d-e16a-4427-9c0d-5f8f302e847f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.884419] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bcf9f2d-e16a-4427-9c0d-5f8f302e847f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.387434] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.387832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.388092] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3377341-8fcc-4f3f-b4b7-a51279fee1e6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.393831] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6bcf9f2d-e16a-4427-9c0d-5f8f302e847f with status ACTIVE [ 635.393831] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.393831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.393831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.393831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.393831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.393831] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.393831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.393831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.393831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.393831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.393831] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.393831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.393831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.393831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.393831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.393831] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6bcf9f2d-e16a-4427-9c0d-5f8f302e847f is going to be updated. [ 635.420608] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.421023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.421023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.422197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.422197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.422197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bcf9f2d-e16a-4427-9c0d-5f8f302e847f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.890992] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3377341-8fcc-4f3f-b4b7-a51279fee1e6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.928245] env[65136]: INFO networking_nsxv3.common.synchronization [req-564673f3-19f2-43fd-9f94-7dd836352170 req-0d4ba4c0-56b3-4196-983f-49cb2a5aca56 tempest-AttachInterfacesV270Test-748732503 tempest-AttachInterfacesV270Test-748732503-project-member] Enqueued Resource ID: 2e54885c-f399-4f6d-8492-fac933ed5006 with Priority: HIGHEST for action security_group_members [ 635.929019] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e54885c-f399-4f6d-8492-fac933ed5006 with Priority: HIGHEST for action security_group_members [ 635.929429] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e54885c-f399-4f6d-8492-fac933ed5006 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.929577] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.929630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.929828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.930398] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.930575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.930575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.930773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.930841] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.930918] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e54885c-f399-4f6d-8492-fac933ed5006',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.393469] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.393865] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.393865] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.393972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.397024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.397024] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 is going to be created. [ 636.423501] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.423501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.423501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.423501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.423501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.433383] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.433610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.433703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.434282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.434621] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.434795] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.434945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.435023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.435218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.435301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.435393] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e54885c-f399-4f6d-8492-fac933ed5006 is going to be updated. [ 636.437864] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 in Status: UNINITIALIZED for 2s [ 636.483897] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.484133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.484133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.484506] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.484658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.499070] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e54885c-f399-4f6d-8492-fac933ed5006 in Status: IN_PROGRESS for 2s [ 636.773198] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: SUCCESS [ 636.773262] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.920490] env[65136]: INFO networking_nsxv3.common.synchronization [req-d3893610-a3b8-4808-959b-32902ad27229 req-8cc146f8-adfc-4ecf-a91c-a50cbf05153a tempest-ServerDiagnosticsNegativeTest-276633888 tempest-ServerDiagnosticsNegativeTest-276633888-project-member] Enqueued Resource ID: 7f41536b-89cc-4053-984d-cc435f2aab48 with Priority: HIGHEST for action security_group_members [ 636.921147] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f41536b-89cc-4053-984d-cc435f2aab48 with Priority: HIGHEST for action security_group_members [ 636.921775] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f41536b-89cc-4053-984d-cc435f2aab48 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.921775] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.921775] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.922024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.922200] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.922303] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.922365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.922559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.923456] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.923456] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f41536b-89cc-4053-984d-cc435f2aab48',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.428834] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.429444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.429444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.429444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.429444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.429647] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.429788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.429788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.429924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.430014] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.430178] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f41536b-89cc-4053-984d-cc435f2aab48 already deleted. [ 637.430313] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.599023] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.599311] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.599357] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.599625] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.599879] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.600041] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.600390] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.600616] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.600765] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.600977] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.601554] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 637.601682] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 637.601791] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 637.601903] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.602015] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 637.602166] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 637.624044] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 637.624388] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 637.624544] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 637.624721] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.625049] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-677be449-da33-4c28-89cc-cf3fa9b36c33 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.625224] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-677be449-da33-4c28-89cc-cf3fa9b36c33" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.625389] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-677be449-da33-4c28-89cc-cf3fa9b36c33" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.625739] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-677be449-da33-4c28-89cc-cf3fa9b36c33" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.625951] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('677be449-da33-4c28-89cc-cf3fa9b36c33',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.129065] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.129350] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.129526] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.129828] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.130739] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.131787] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 677be449-da33-4c28-89cc-cf3fa9b36c33 not found, creating... [ 638.131787] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.131787] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.131787] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.132328] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.132328] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.132328] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.132445] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.133135] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.133135] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.133135] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.133135] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 677be449-da33-4c28-89cc-cf3fa9b36c33 is going to be created. [ 638.159607] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.159815] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.159992] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.160322] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.160569] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.160798] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-677be449-da33-4c28-89cc-cf3fa9b36c33" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.448295] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 in Status: SUCCESS [ 638.448604] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.448704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.448987] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.449207] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.449335] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.449404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.449564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.449649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.449734] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.449826] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3377341-8fcc-4f3f-b4b7-a51279fee1e6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.513395] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e54885c-f399-4f6d-8492-fac933ed5006 in Status: SUCCESS [ 638.513486] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e54885c-f399-4f6d-8492-fac933ed5006 deletion is rescheduled due to dependency. [ 638.513579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.879402] env[65136]: INFO networking_nsxv3.common.synchronization [req-d3893610-a3b8-4808-959b-32902ad27229 req-10c77db0-7908-4238-9db6-75f5f1d2d5ef service nova] Enqueued Resource ID: 7f41536b-89cc-4053-984d-cc435f2aab48 with Priority: HIGHEST for action security_group_rules [ 638.879682] env[65136]: INFO networking_nsxv3.common.synchronization [req-d3893610-a3b8-4808-959b-32902ad27229 req-10c77db0-7908-4238-9db6-75f5f1d2d5ef service nova] Enqueued Resource ID: 7f41536b-89cc-4053-984d-cc435f2aab48 with Priority: HIGHEST for action security_group_members [ 638.879734] env[65136]: INFO networking_nsxv3.common.synchronization [req-d3893610-a3b8-4808-959b-32902ad27229 req-10c77db0-7908-4238-9db6-75f5f1d2d5ef service nova] Enqueued Resource ID: 677be449-da33-4c28-89cc-cf3fa9b36c33 with Priority: HIGHEST for action port [ 638.879931] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f41536b-89cc-4053-984d-cc435f2aab48 with Priority: HIGHEST for action security_group_rules [ 638.880188] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f41536b-89cc-4053-984d-cc435f2aab48 with Priority: HIGHEST for action security_group_members [ 638.880283] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 677be449-da33-4c28-89cc-cf3fa9b36c33 with Priority: HIGHEST for action port [ 638.880879] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f41536b-89cc-4053-984d-cc435f2aab48 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.880985] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.881665] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.881956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.882085] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f41536b-89cc-4053-984d-cc435f2aab48',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.882971] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f41536b-89cc-4053-984d-cc435f2aab48 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.883083] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.883491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.883491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.883491] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.883763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.883763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.883763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.883914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.883914] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f41536b-89cc-4053-984d-cc435f2aab48',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.885037] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-677be449-da33-4c28-89cc-cf3fa9b36c33 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.885190] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-677be449-da33-4c28-89cc-cf3fa9b36c33" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.885257] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-677be449-da33-4c28-89cc-cf3fa9b36c33" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.885405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-677be449-da33-4c28-89cc-cf3fa9b36c33" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.885502] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('677be449-da33-4c28-89cc-cf3fa9b36c33',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.955757] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.955757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.955757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.955997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.955997] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.956113] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.956153] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.958298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.958298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.958298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.958298] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.958298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.958298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.958298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.958298] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.958298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.958298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.958298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.958298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.958298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.958298] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3377341-8fcc-4f3f-b4b7-a51279fee1e6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.388354] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f41536b-89cc-4053-984d-cc435f2aab48 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.388581] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.388829] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f41536b-89cc-4053-984d-cc435f2aab48',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.394544] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 677be449-da33-4c28-89cc-cf3fa9b36c33 with status ACTIVE [ 639.394773] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.394903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.394972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.395484] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.395484] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.395484] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.395655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.395655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.395901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.395998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.396213] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.396289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.396348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.396536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.396642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.396753] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 677be449-da33-4c28-89cc-cf3fa9b36c33 is going to be updated. [ 639.420287] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.420535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.420630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.420929] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.421885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.422232] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-677be449-da33-4c28-89cc-cf3fa9b36c33" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.460696] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3377341-8fcc-4f3f-b4b7-a51279fee1e6: rpc.has_security_group_logging(os_id): False [ 639.491825] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.491825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.491825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.491825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.491825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.491825] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.491825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.491825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.491825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.491825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.491825] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.491825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.491825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.491825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.491825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.498401] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.498401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.498401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.498401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.498401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.498401] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 is going to be created. [ 639.584603] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.584603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.584603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.584603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.584603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.598884] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 in Status: IN_PROGRESS for 2s [ 639.823137] env[65136]: INFO networking_nsxv3.common.synchronization [None req-048225e9-f9f5-4381-b277-08e2aba0e316 None None] Enqueued Resource ID: ae91da7e-c499-4765-8d0f-f38a1a27e6a5 with Priority: HIGHEST for action port [ 639.823648] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae91da7e-c499-4765-8d0f-f38a1a27e6a5 with Priority: HIGHEST for action port [ 639.823952] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae91da7e-c499-4765-8d0f-f38a1a27e6a5 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.828395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae91da7e-c499-4765-8d0f-f38a1a27e6a5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.828395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae91da7e-c499-4765-8d0f-f38a1a27e6a5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.828592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae91da7e-c499-4765-8d0f-f38a1a27e6a5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.828649] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae91da7e-c499-4765-8d0f-f38a1a27e6a5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.895548] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f41536b-89cc-4053-984d-cc435f2aab48',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.332175] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae91da7e-c499-4765-8d0f-f38a1a27e6a5 [ 640.332462] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.332607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.332676] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.332986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.332986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.333208] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae91da7e-c499-4765-8d0f-f38a1a27e6a5 already deleted. [ 640.333208] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae91da7e-c499-4765-8d0f-f38a1a27e6a5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.400081] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.400282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.400282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.400504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.400611] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.400955] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f41536b-89cc-4053-984d-cc435f2aab48 is going to be created. [ 640.426771] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.427024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.427024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.427228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.427401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.439767] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f41536b-89cc-4053-984d-cc435f2aab48 in Status: UNINITIALIZED for 2s [ 640.585963] env[65136]: INFO networking_nsxv3.common.synchronization [None req-5d97c3e5-c902-471d-9522-bf0d14199831 None None] Enqueued Resource ID: 3068e6fe-c009-4eb3-88c3-7edbed39e26b with Priority: HIGHEST for action port [ 640.587308] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3068e6fe-c009-4eb3-88c3-7edbed39e26b with Priority: HIGHEST for action port [ 640.587642] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-3068e6fe-c009-4eb3-88c3-7edbed39e26b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.587783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3068e6fe-c009-4eb3-88c3-7edbed39e26b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.587874] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3068e6fe-c009-4eb3-88c3-7edbed39e26b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.588213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3068e6fe-c009-4eb3-88c3-7edbed39e26b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.588300] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3068e6fe-c009-4eb3-88c3-7edbed39e26b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.790197] env[65136]: INFO networking_nsxv3.common.synchronization [req-e92df820-b9c0-473c-b3fb-a5aa29d38537 req-1d917c9e-f458-445e-a4f4-7f8c618fe98d tempest-ServerExternalEventsTest-847490909 tempest-ServerExternalEventsTest-847490909-project-member] Enqueued Resource ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd with Priority: HIGHEST for action security_group_members [ 640.790197] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd with Priority: HIGHEST for action security_group_members [ 640.790197] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.790197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.790197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.790197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.790197] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.790197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.790197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.790197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.790197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.790197] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.091138] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3068e6fe-c009-4eb3-88c3-7edbed39e26b [ 641.092688] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.092688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.093438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.093815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.093947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.094093] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3068e6fe-c009-4eb3-88c3-7edbed39e26b already deleted. [ 641.094189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3068e6fe-c009-4eb3-88c3-7edbed39e26b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.271453] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.271453] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.271453] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.271453] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.272045] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.272426] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.272703] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.273100] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.273418] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.273924] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.274231] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.274506] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.274752] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.275055] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.275297] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.275574] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.294811] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.294811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.294811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.294811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.294811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.294811] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.294811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.294811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.294811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.295336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.295336] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd already deleted. [ 641.295336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.307226] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.307371] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 641.308430] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.308430] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.308430] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-e7ebb419-5e18-42d4-930c-39e5069a35c0 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.308430] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-e7ebb419-5e18-42d4-930c-39e5069a35c0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.308430] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-e7ebb419-5e18-42d4-930c-39e5069a35c0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.308735] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-e7ebb419-5e18-42d4-930c-39e5069a35c0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.308735] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7ebb419-5e18-42d4-930c-39e5069a35c0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.315596] env[65136]: INFO networking_nsxv3.common.synchronization [None req-2bf96707-ed1b-4efd-aba5-4fe044717bf2 None None] Enqueued Resource ID: 269369a5-5784-49ff-8c8f-1711486954ae with Priority: HIGHEST for action port [ 641.316835] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 269369a5-5784-49ff-8c8f-1711486954ae with Priority: HIGHEST for action port [ 641.317264] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-269369a5-5784-49ff-8c8f-1711486954ae taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.317445] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-269369a5-5784-49ff-8c8f-1711486954ae" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.317515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-269369a5-5784-49ff-8c8f-1711486954ae" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.317793] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-269369a5-5784-49ff-8c8f-1711486954ae" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.317940] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('269369a5-5784-49ff-8c8f-1711486954ae',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.614444] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 in Status: SUCCESS [ 641.614788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.811258] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.811511] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.811649] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.812078] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.812722] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.812722] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port e7ebb419-5e18-42d4-930c-39e5069a35c0 not found, creating... [ 641.812846] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.813024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.813143] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.813387] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.813549] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.814403] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.814403] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.814403] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.814403] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.814746] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.814793] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: e7ebb419-5e18-42d4-930c-39e5069a35c0 is going to be created. [ 641.819622] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 269369a5-5784-49ff-8c8f-1711486954ae [ 641.819812] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.819927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.819997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.820211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.821855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.821855] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:269369a5-5784-49ff-8c8f-1711486954ae already deleted. [ 641.821855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-269369a5-5784-49ff-8c8f-1711486954ae" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.852415] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.852615] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.852734] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.852995] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.853261] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.853484] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-e7ebb419-5e18-42d4-930c-39e5069a35c0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.452959] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f41536b-89cc-4053-984d-cc435f2aab48 in Status: SUCCESS [ 642.453672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.453984] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.454326] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.454843] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.455998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.456207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.456610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.457062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.457283] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.457512] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f41536b-89cc-4053-984d-cc435f2aab48',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.596375] env[65136]: INFO networking_nsxv3.common.synchronization [None req-813f2426-8a9f-4e5c-b78b-3a06ad6a7f99 None None] Enqueued Resource ID: 9f6a1def-7148-48f7-a5a8-7110bdffb42c with Priority: HIGHEST for action port [ 642.596375] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f6a1def-7148-48f7-a5a8-7110bdffb42c with Priority: HIGHEST for action port [ 642.596884] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f6a1def-7148-48f7-a5a8-7110bdffb42c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.597380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f6a1def-7148-48f7-a5a8-7110bdffb42c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.597593] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f6a1def-7148-48f7-a5a8-7110bdffb42c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.598034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f6a1def-7148-48f7-a5a8-7110bdffb42c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.599784] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f6a1def-7148-48f7-a5a8-7110bdffb42c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.602403] env[65136]: INFO networking_nsxv3.common.synchronization [req-e92df820-b9c0-473c-b3fb-a5aa29d38537 req-7d722a5d-1e4a-4b1d-8049-68b2d07251c5 service nova] Enqueued Resource ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd with Priority: HIGHEST for action security_group_rules [ 642.603586] env[65136]: INFO networking_nsxv3.common.synchronization [req-e92df820-b9c0-473c-b3fb-a5aa29d38537 req-7d722a5d-1e4a-4b1d-8049-68b2d07251c5 service nova] Enqueued Resource ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd with Priority: HIGHEST for action security_group_members [ 642.603935] env[65136]: INFO networking_nsxv3.common.synchronization [req-e92df820-b9c0-473c-b3fb-a5aa29d38537 req-7d722a5d-1e4a-4b1d-8049-68b2d07251c5 service nova] Enqueued Resource ID: e7ebb419-5e18-42d4-930c-39e5069a35c0 with Priority: HIGHEST for action port [ 642.611691] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd with Priority: HIGHEST for action security_group_rules [ 642.611691] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd with Priority: HIGHEST for action security_group_members [ 642.611691] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7ebb419-5e18-42d4-930c-39e5069a35c0 with Priority: HIGHEST for action port [ 642.611691] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.611691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.611691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.611691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.611691] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.613081] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.613469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.615075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.615075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.615075] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.615075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.615075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.615075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.615075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.615075] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.616483] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7ebb419-5e18-42d4-930c-39e5069a35c0 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.616483] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7ebb419-5e18-42d4-930c-39e5069a35c0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.616483] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7ebb419-5e18-42d4-930c-39e5069a35c0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.616683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7ebb419-5e18-42d4-930c-39e5069a35c0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.616912] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7ebb419-5e18-42d4-930c-39e5069a35c0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.961021] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f41536b-89cc-4053-984d-cc435f2aab48 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.961021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.961021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.961021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.961021] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.961021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.961021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.962269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.962682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.965222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.965222] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f41536b-89cc-4053-984d-cc435f2aab48 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.965222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.965518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.965518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.966126] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.966126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.966126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.966660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.966660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.966660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.967010] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f41536b-89cc-4053-984d-cc435f2aab48',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.102332] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f6a1def-7148-48f7-a5a8-7110bdffb42c [ 643.102566] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.102709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.102780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.103063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.103176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.103277] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f6a1def-7148-48f7-a5a8-7110bdffb42c already deleted. [ 643.103359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f6a1def-7148-48f7-a5a8-7110bdffb42c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.120452] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.122958] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.127603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.127603] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7ebb419-5e18-42d4-930c-39e5069a35c0 with status ACTIVE [ 643.127603] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.127603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.127603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.129329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.129442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.129678] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.129796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.129869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.130111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.130288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.130400] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.130525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.130635] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.130883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.131063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.131286] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7ebb419-5e18-42d4-930c-39e5069a35c0 is going to be updated. [ 643.156671] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.157963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.157963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.157963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.157963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.157963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7ebb419-5e18-42d4-930c-39e5069a35c0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.463696] env[65136]: INFO networking_nsxv3.common.synchronization [req-bd61879b-4096-4cbf-9306-0ad5d9bd556c req-6df98912-7693-4ace-a2ed-8005b390d774 tempest-VolumesAdminNegativeTest-1818602586 tempest-VolumesAdminNegativeTest-1818602586-project-member] Enqueued Resource ID: 4b70c67f-c559-421c-8bdc-2943731f1140 with Priority: HIGHEST for action security_group_members [ 643.466707] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b70c67f-c559-421c-8bdc-2943731f1140 with Priority: HIGHEST for action security_group_members [ 643.467083] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b70c67f-c559-421c-8bdc-2943731f1140 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.467233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.467296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.467614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.467780] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.467933] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.468035] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.468222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.468350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.468503] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b70c67f-c559-421c-8bdc-2943731f1140',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.469748] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f41536b-89cc-4053-984d-cc435f2aab48: rpc.has_security_group_logging(os_id): False [ 643.495767] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.496092] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.496092] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.497890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.497890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.497890] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.497890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.497890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.498199] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.498199] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.498320] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.498425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.498503] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.498685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.498765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.499057] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.499205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.499247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.499485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.499485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.499587] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f41536b-89cc-4053-984d-cc435f2aab48 is going to be created. [ 643.533808] env[65136]: INFO networking_nsxv3.common.synchronization [None req-36687ed7-d2cf-41f9-aa93-affe0f27f818 None None] Enqueued Resource ID: 996bbed4-602d-42bb-8f3c-3e4b75e58218 with Priority: HIGHEST for action port [ 643.534559] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 996bbed4-602d-42bb-8f3c-3e4b75e58218 with Priority: HIGHEST for action port [ 643.534866] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-996bbed4-602d-42bb-8f3c-3e4b75e58218 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.535033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-996bbed4-602d-42bb-8f3c-3e4b75e58218" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.535242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-996bbed4-602d-42bb-8f3c-3e4b75e58218" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.535506] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-996bbed4-602d-42bb-8f3c-3e4b75e58218" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.535791] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('996bbed4-602d-42bb-8f3c-3e4b75e58218',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.571173] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.571660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.571829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.572065] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.572334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.585750] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f41536b-89cc-4053-984d-cc435f2aab48 in Status: IN_PROGRESS for 2s [ 643.626618] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.905289] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-807 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.905493] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-807" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.905608] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-807" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.906369] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-807" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.906369] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.906529] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.906567] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.906827] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.906924] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.909116] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.909248] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.909364] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.909524] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.909582] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.909672] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.909803] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.930632] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.930799] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 643.930942] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.931122] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-807" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.931451] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.931615] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.931724] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.932063] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.932244] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.977026] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.977026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.977026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.977026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.977321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.977497] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.978194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.978194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.978194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.978194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.978429] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b70c67f-c559-421c-8bdc-2943731f1140 already deleted. [ 643.978429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.039860] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 996bbed4-602d-42bb-8f3c-3e4b75e58218 [ 644.040171] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.040294] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.041963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.041963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.041963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.041963] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:996bbed4-602d-42bb-8f3c-3e4b75e58218 already deleted. [ 644.041963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-996bbed4-602d-42bb-8f3c-3e4b75e58218" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.042624] env[65136]: INFO networking_nsxv3.common.synchronization [None req-f08504e5-572f-4395-8c6f-5b856974b4d8 None None] Enqueued Resource ID: 061c1298-faba-4094-b583-5272a0d44d66 with Priority: HIGHEST for action port [ 644.043454] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 061c1298-faba-4094-b583-5272a0d44d66 with Priority: HIGHEST for action port [ 644.044284] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-061c1298-faba-4094-b583-5272a0d44d66 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.044464] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-061c1298-faba-4094-b583-5272a0d44d66" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.044581] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-061c1298-faba-4094-b583-5272a0d44d66" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.045110] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-061c1298-faba-4094-b583-5272a0d44d66" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.045110] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('061c1298-faba-4094-b583-5272a0d44d66',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.131045] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.131045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.131045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.131045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.131045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.131045] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd is going to be created. [ 644.156500] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.156668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.156738] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.156972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.157162] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.169368] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd in Status: UNINITIALIZED for 2s [ 644.308873] env[65136]: INFO networking_nsxv3.common.synchronization [None req-02d70d00-9e11-45db-8f97-5eaaf0035d1e tempest-ServerActionsV293TestJSON-1327897741 tempest-ServerActionsV293TestJSON-1327897741-project-member] Enqueued Resource ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a with Priority: HIGHEST for action security_group_rules [ 644.309038] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a with Priority: HIGHEST for action security_group_rules [ 644.310580] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-837b8c63-6d80-45d3-a9be-427d83c5b42a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.310795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.310795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.311059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.311171] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('837b8c63-6d80-45d3-a9be-427d83c5b42a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.437045] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.440145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.440145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.440145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.440145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.440145] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8 not found, creating... [ 644.440145] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.440145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.440145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.440145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.440145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.440678] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.440678] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.440678] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.440678] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.440678] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.440991] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8 is going to be created. [ 644.463482] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.463771] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.463926] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.464134] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.464374] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.465027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.489094] env[65136]: INFO networking_nsxv3.common.synchronization [None req-b53f4849-9680-43aa-9010-275bebca8ece tempest-ServerActionsV293TestJSON-1327897741 tempest-ServerActionsV293TestJSON-1327897741-project-member] Enqueued Resource ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a with Priority: HIGHEST for action security_group_rules [ 644.490787] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a with Priority: HIGHEST for action security_group_rules [ 644.490787] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-837b8c63-6d80-45d3-a9be-427d83c5b42a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.490787] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.549411] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 061c1298-faba-4094-b583-5272a0d44d66 [ 644.549631] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.549763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.549848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.550771] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.551465] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.551517] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:061c1298-faba-4094-b583-5272a0d44d66 already deleted. [ 644.551567] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-061c1298-faba-4094-b583-5272a0d44d66" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.837180] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.837672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.837672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.837672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.837867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.837867] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a already deleted. [ 644.837962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.838218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.838415] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.838501] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('837b8c63-6d80-45d3-a9be-427d83c5b42a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.270429] env[65136]: INFO networking_nsxv3.common.synchronization [req-bd61879b-4096-4cbf-9306-0ad5d9bd556c req-a3fa290e-f532-4938-a0df-bc0a2ae97d0e service nova] Enqueued Resource ID: 4b70c67f-c559-421c-8bdc-2943731f1140 with Priority: HIGHEST for action security_group_rules [ 645.271306] env[65136]: INFO networking_nsxv3.common.synchronization [req-bd61879b-4096-4cbf-9306-0ad5d9bd556c req-a3fa290e-f532-4938-a0df-bc0a2ae97d0e service nova] Enqueued Resource ID: 4b70c67f-c559-421c-8bdc-2943731f1140 with Priority: HIGHEST for action security_group_members [ 645.271306] env[65136]: INFO networking_nsxv3.common.synchronization [req-bd61879b-4096-4cbf-9306-0ad5d9bd556c req-a3fa290e-f532-4938-a0df-bc0a2ae97d0e service nova] Enqueued Resource ID: 1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8 with Priority: HIGHEST for action port [ 645.271508] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b70c67f-c559-421c-8bdc-2943731f1140 with Priority: HIGHEST for action security_group_rules [ 645.273034] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b70c67f-c559-421c-8bdc-2943731f1140 with Priority: HIGHEST for action security_group_members [ 645.273034] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8 with Priority: HIGHEST for action port [ 645.273835] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b70c67f-c559-421c-8bdc-2943731f1140 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.273835] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.274398] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.276370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.276479] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b70c67f-c559-421c-8bdc-2943731f1140',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.277742] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b70c67f-c559-421c-8bdc-2943731f1140 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.280030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.280030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.280030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.280030] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.280030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.280030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.280030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.280030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.280030] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b70c67f-c559-421c-8bdc-2943731f1140',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.283042] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.283042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.283042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.283042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.283042] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.365469] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.365469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.365711] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.366307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.366307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.366307] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a already deleted. [ 645.366307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.522673] env[65136]: INFO networking_nsxv3.common.synchronization [None req-392631d6-c4df-4502-91e0-8c0884c3394d tempest-ServersV294TestFqdnHostnames-1024632663 tempest-ServersV294TestFqdnHostnames-1024632663-project-member] Enqueued Resource ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d with Priority: HIGHEST for action security_group_rules [ 645.522673] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d with Priority: HIGHEST for action security_group_rules [ 645.522673] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5640a309-d0fa-4870-9eee-f2caeb1f4b8d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.522673] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.522673] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.522673] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.522673] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5640a309-d0fa-4870-9eee-f2caeb1f4b8d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.606421] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f41536b-89cc-4053-984d-cc435f2aab48 in Status: SUCCESS [ 645.607132] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.656522] env[65136]: INFO networking_nsxv3.common.synchronization [None req-3fbd6f12-efb4-46b3-babb-62e201a92ffa tempest-ServersV294TestFqdnHostnames-1024632663 tempest-ServersV294TestFqdnHostnames-1024632663-project-member] Enqueued Resource ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d with Priority: HIGHEST for action security_group_rules [ 645.656522] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d with Priority: HIGHEST for action security_group_rules [ 645.657308] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5640a309-d0fa-4870-9eee-f2caeb1f4b8d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.657308] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.787691] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8 with status ACTIVE [ 645.788856] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.788856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.788856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.791364] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.791461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.792553] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.792553] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.792553] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.792553] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.792553] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.792553] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.792913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.792913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.792913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.792913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.793054] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8 is going to be updated. [ 645.794529] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b70c67f-c559-421c-8bdc-2943731f1140 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.794529] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.794887] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b70c67f-c559-421c-8bdc-2943731f1140',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.828050] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.828050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.828050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.828050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.828050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.828050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b6bd92b-2a75-4b7e-a7a9-0a95a8d676f8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.048028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.048028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.048028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.048028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.048028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.048028] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d already deleted. [ 646.048028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.048028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.048028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.048028] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5640a309-d0fa-4870-9eee-f2caeb1f4b8d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.182774] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd in Status: SUCCESS [ 646.183087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.183299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.183556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.183786] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.183939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.184126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.184317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.184424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.184541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.184662] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.299907] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b70c67f-c559-421c-8bdc-2943731f1140',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.572093] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.572266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.572332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.572555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.572640] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.572742] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d already deleted. [ 646.572975] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.690821] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.690821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.690821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.690821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.690821] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.690821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.690821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.690821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.690821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.690821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.690821] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.690821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.690821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.690821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.690821] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.690821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.691532] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.691532] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.691532] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.691532] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.691532] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.803193] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.803193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.803193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.803193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.803193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.803193] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b70c67f-c559-421c-8bdc-2943731f1140 is going to be created. [ 646.835074] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.835299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.835489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.836685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.836915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.853369] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b70c67f-c559-421c-8bdc-2943731f1140 in Status: UNINITIALIZED for 2s [ 647.195640] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd: rpc.has_security_group_logging(os_id): False [ 647.218370] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.218541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.218584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.218790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.218878] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.219314] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.219314] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.219443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.219612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.219679] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.219880] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.220030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.220710] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.221105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.221649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.221944] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.222130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.222238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.222384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.222466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.222562] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd is going to be created. [ 647.320970] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.321244] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.321383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.321681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.321971] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.343994] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd in Status: IN_PROGRESS for 2s [ 648.212423] env[65136]: INFO networking_nsxv3.common.synchronization [req-297c2675-bdca-49ce-ab8f-895eebc89486 req-631ae26c-5697-4c21-a4ae-e3e75278ea24 tempest-InstanceActionsNegativeTestJSON-1249202560 tempest-InstanceActionsNegativeTestJSON-1249202560-project-member] Enqueued Resource ID: d789ffc8-c337-422a-bd53-59d582b7cf8f with Priority: HIGHEST for action security_group_members [ 648.213118] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d789ffc8-c337-422a-bd53-59d582b7cf8f with Priority: HIGHEST for action security_group_members [ 648.213707] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d789ffc8-c337-422a-bd53-59d582b7cf8f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.213899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.213940] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.214326] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.214433] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.214515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.214582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.214797] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.214919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.215048] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d789ffc8-c337-422a-bd53-59d582b7cf8f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.702110] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-202 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.702110] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-202" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.702371] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-202" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.702642] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-202" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.702839] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.703116] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.703218] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.703373] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.703510] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.703751] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.703945] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 648.703945] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 648.704086] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 648.704173] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 648.704289] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 648.704512] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 648.718513] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.718513] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.718880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.718930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.719333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.720323] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.720524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.720524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.720749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.720948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.721060] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d789ffc8-c337-422a-bd53-59d582b7cf8f already deleted. [ 648.721179] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.726973] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 648.727355] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 648.727355] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 648.727503] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-202" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.727902] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-384ebd1c-2282-4595-977a-94d00fbc9990 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.728318] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-384ebd1c-2282-4595-977a-94d00fbc9990" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.728318] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-384ebd1c-2282-4595-977a-94d00fbc9990" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.728639] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-384ebd1c-2282-4595-977a-94d00fbc9990" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.728775] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('384ebd1c-2282-4595-977a-94d00fbc9990',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.865716] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b70c67f-c559-421c-8bdc-2943731f1140 in Status: SUCCESS [ 648.866058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.866327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.866510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.866712] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.866864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.866950] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.867124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.867391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.867524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.867757] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b70c67f-c559-421c-8bdc-2943731f1140',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.231517] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.232042] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.232042] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.232262] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.232419] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.232573] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 384ebd1c-2282-4595-977a-94d00fbc9990 not found, creating... [ 649.232835] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.232990] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.233128] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.233377] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.233474] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.233746] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.233898] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.234040] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.234268] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.234400] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.234687] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 384ebd1c-2282-4595-977a-94d00fbc9990 is going to be created. [ 649.263335] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.263639] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.263639] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.263906] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.264150] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.264377] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-384ebd1c-2282-4595-977a-94d00fbc9990" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.360896] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd in Status: SUCCESS [ 649.362176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.369772] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b70c67f-c559-421c-8bdc-2943731f1140 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.369915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.369982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.370362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.370553] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.370661] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.370727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.370899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.370988] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.371089] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.371285] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b70c67f-c559-421c-8bdc-2943731f1140 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.371354] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.371431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.371730] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.371730] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.371840] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.371840] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.371995] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.372107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.372221] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.372346] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b70c67f-c559-421c-8bdc-2943731f1140',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.874706] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b70c67f-c559-421c-8bdc-2943731f1140: rpc.has_security_group_logging(os_id): False [ 649.899752] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.899999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.900189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.900552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.900707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.901933] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.902192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.902192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.902540] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.902901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.903278] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.903838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.903930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.904493] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.904595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.904936] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.905143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.905249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.905449] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.905536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.905638] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b70c67f-c559-421c-8bdc-2943731f1140 is going to be created. [ 649.998342] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.998342] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.998342] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.998342] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.998342] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.018967] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b70c67f-c559-421c-8bdc-2943731f1140 in Status: IN_PROGRESS for 2s [ 650.112873] env[65136]: INFO networking_nsxv3.common.synchronization [req-297c2675-bdca-49ce-ab8f-895eebc89486 req-90907c9e-550a-469c-81e9-9583512f16e8 service nova] Enqueued Resource ID: d789ffc8-c337-422a-bd53-59d582b7cf8f with Priority: HIGHEST for action security_group_rules [ 650.113125] env[65136]: INFO networking_nsxv3.common.synchronization [req-297c2675-bdca-49ce-ab8f-895eebc89486 req-90907c9e-550a-469c-81e9-9583512f16e8 service nova] Enqueued Resource ID: d789ffc8-c337-422a-bd53-59d582b7cf8f with Priority: HIGHEST for action security_group_members [ 650.113377] env[65136]: INFO networking_nsxv3.common.synchronization [req-297c2675-bdca-49ce-ab8f-895eebc89486 req-90907c9e-550a-469c-81e9-9583512f16e8 service nova] Enqueued Resource ID: 384ebd1c-2282-4595-977a-94d00fbc9990 with Priority: HIGHEST for action port [ 650.118825] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d789ffc8-c337-422a-bd53-59d582b7cf8f with Priority: HIGHEST for action security_group_rules [ 650.119124] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d789ffc8-c337-422a-bd53-59d582b7cf8f with Priority: HIGHEST for action security_group_members [ 650.119285] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384ebd1c-2282-4595-977a-94d00fbc9990 with Priority: HIGHEST for action port [ 650.119894] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d789ffc8-c337-422a-bd53-59d582b7cf8f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.120060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.120252] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.120653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.120860] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d789ffc8-c337-422a-bd53-59d582b7cf8f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.128517] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d789ffc8-c337-422a-bd53-59d582b7cf8f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.128517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.128517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.128827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.129206] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.129429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.129526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.129823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.129969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.130169] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d789ffc8-c337-422a-bd53-59d582b7cf8f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.131842] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-384ebd1c-2282-4595-977a-94d00fbc9990 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.132063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-384ebd1c-2282-4595-977a-94d00fbc9990" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.137595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-384ebd1c-2282-4595-977a-94d00fbc9990" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.137595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-384ebd1c-2282-4595-977a-94d00fbc9990" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.137595] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('384ebd1c-2282-4595-977a-94d00fbc9990',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.638388] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d789ffc8-c337-422a-bd53-59d582b7cf8f taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.638705] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.638967] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d789ffc8-c337-422a-bd53-59d582b7cf8f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.641693] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 384ebd1c-2282-4595-977a-94d00fbc9990 with status ACTIVE [ 650.642209] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.642209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.642402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.642485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.642519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.646047] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.646047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.646047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.646047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.646047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.646047] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.646047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.646047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.646047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.646047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.646047] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 384ebd1c-2282-4595-977a-94d00fbc9990 is going to be updated. [ 650.669088] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.669312] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.669397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.669624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.669784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.669949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-384ebd1c-2282-4595-977a-94d00fbc9990" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.105857] env[65136]: INFO networking_nsxv3.common.synchronization [None req-59410f5e-f6fc-4301-b54e-0b5d5e484008 None None] Enqueued Resource ID: 05d8f313-6c01-4dd4-9730-3e27c7a84cd5 with Priority: HIGHEST for action port [ 651.106717] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05d8f313-6c01-4dd4-9730-3e27c7a84cd5 with Priority: HIGHEST for action port [ 651.106819] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-05d8f313-6c01-4dd4-9730-3e27c7a84cd5 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.107389] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05d8f313-6c01-4dd4-9730-3e27c7a84cd5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.107389] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05d8f313-6c01-4dd4-9730-3e27c7a84cd5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.107389] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05d8f313-6c01-4dd4-9730-3e27c7a84cd5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.107389] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05d8f313-6c01-4dd4-9730-3e27c7a84cd5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.142705] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d789ffc8-c337-422a-bd53-59d582b7cf8f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.611180] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05d8f313-6c01-4dd4-9730-3e27c7a84cd5 [ 651.611180] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.613517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.614075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.614075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.614075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.614217] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05d8f313-6c01-4dd4-9730-3e27c7a84cd5 already deleted. [ 651.614250] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05d8f313-6c01-4dd4-9730-3e27c7a84cd5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.648953] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.651280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.651373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.651583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.651668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.651806] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d789ffc8-c337-422a-bd53-59d582b7cf8f is going to be created. [ 651.679656] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.679656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.679656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.679656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.681229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.694690] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d789ffc8-c337-422a-bd53-59d582b7cf8f in Status: UNINITIALIZED for 2s [ 652.036820] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b70c67f-c559-421c-8bdc-2943731f1140 in Status: SUCCESS [ 652.037599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.270209] env[65136]: INFO networking_nsxv3.common.synchronization [None req-6d760486-bd99-40db-b21a-9f2d4fcda4ae None None] Enqueued Resource ID: 8b4654ae-4a74-4978-b02a-45a01c3754ba with Priority: HIGHEST for action port [ 652.271092] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b4654ae-4a74-4978-b02a-45a01c3754ba with Priority: HIGHEST for action port [ 652.271329] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b4654ae-4a74-4978-b02a-45a01c3754ba taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.271329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b4654ae-4a74-4978-b02a-45a01c3754ba" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.271464] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b4654ae-4a74-4978-b02a-45a01c3754ba" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.272060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b4654ae-4a74-4978-b02a-45a01c3754ba" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.272060] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b4654ae-4a74-4978-b02a-45a01c3754ba',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.679381] env[65136]: INFO networking_nsxv3.common.synchronization [req-ff9e0cad-66b4-4fbc-a0de-b7ac22374db7 req-b4324621-da4d-4494-a089-220559f6d2e9 tempest-ServersAdminNegativeTestJSON-1000543325 tempest-ServersAdminNegativeTestJSON-1000543325-project-member] Enqueued Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_members [ 652.679381] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_members [ 652.680385] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-39322202-687d-409e-86ef-4870f36135e8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.680385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.680385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.680385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.680385] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.681767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.681767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.681767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.681767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.681767] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.775337] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b4654ae-4a74-4978-b02a-45a01c3754ba [ 652.775337] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.775519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.775519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.775742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.775867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.775916] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b4654ae-4a74-4978-b02a-45a01c3754ba already deleted. [ 652.776292] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b4654ae-4a74-4978-b02a-45a01c3754ba" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.108649] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.108809] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.108926] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.109292] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.109652] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.109865] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.110033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.110325] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.110515] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.110781] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.110932] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.111094] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.111238] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.111391] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.111534] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.111706] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.133883] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.137659] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 653.137659] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.137659] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.137659] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-917d8d0e-294c-42e0-95a9-4ce305517dc4 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.137659] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-917d8d0e-294c-42e0-95a9-4ce305517dc4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.137659] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-917d8d0e-294c-42e0-95a9-4ce305517dc4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.137659] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-917d8d0e-294c-42e0-95a9-4ce305517dc4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.137659] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('917d8d0e-294c-42e0-95a9-4ce305517dc4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.183128] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.638684] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.639144] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.639144] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.639335] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.639388] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.639562] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 917d8d0e-294c-42e0-95a9-4ce305517dc4 not found, creating... [ 653.639883] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.640104] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.640308] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.640553] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.640686] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.640968] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.641138] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.641253] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.641476] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.641574] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.641712] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 917d8d0e-294c-42e0-95a9-4ce305517dc4 is going to be created. [ 653.669977] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.670226] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.670346] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.670611] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.670828] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.671085] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-917d8d0e-294c-42e0-95a9-4ce305517dc4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.687746] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.710999] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d789ffc8-c337-422a-bd53-59d582b7cf8f in Status: SUCCESS [ 653.711285] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.711744] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.711953] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.712440] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.712440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.712440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.712633] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.712633] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.712703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.712739] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d789ffc8-c337-422a-bd53-59d582b7cf8f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.940104] env[65136]: INFO networking_nsxv3.common.synchronization [req-0c842b5d-fb51-4f16-997b-797dcdf9a2cf req-feb090c5-50d9-4eae-9425-4310ae66abf5 tempest-InstanceActionsV221TestJSON-434975811 tempest-InstanceActionsV221TestJSON-434975811-project-member] Enqueued Resource ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 with Priority: HIGHEST for action security_group_members [ 653.942304] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 with Priority: HIGHEST for action security_group_members [ 653.942998] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.943269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.943491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.943737] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.943965] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.944123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.944203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.944386] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.944500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.944615] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3377341-8fcc-4f3f-b4b7-a51279fee1e6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.190625] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.190798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.190869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.191118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.191211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.191440] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39322202-687d-409e-86ef-4870f36135e8 is going to be updated. [ 654.216854] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d789ffc8-c337-422a-bd53-59d582b7cf8f taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.216854] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.217125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.217125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.217325] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.217437] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.217493] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.218699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.218699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.218699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.218699] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d789ffc8-c337-422a-bd53-59d582b7cf8f taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.218699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.218699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.218699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.218699] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.218699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.218699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.218699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.219231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.219231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.219231] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d789ffc8-c337-422a-bd53-59d582b7cf8f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.223212] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.223576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.223750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.226718] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.226718] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.239318] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39322202-687d-409e-86ef-4870f36135e8 in Status: IN_PROGRESS for 2s [ 654.279543] env[65136]: INFO networking_nsxv3.common.synchronization [None req-e9e40ae6-5d2e-4562-ad56-b66d0c4f6e60 None None] Enqueued Resource ID: 08b0a134-0b8b-408a-b05b-a7ca32208263 with Priority: HIGHEST for action port [ 654.281200] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08b0a134-0b8b-408a-b05b-a7ca32208263 with Priority: HIGHEST for action port [ 654.282109] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-08b0a134-0b8b-408a-b05b-a7ca32208263 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.282109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08b0a134-0b8b-408a-b05b-a7ca32208263" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.282109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08b0a134-0b8b-408a-b05b-a7ca32208263" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.283227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08b0a134-0b8b-408a-b05b-a7ca32208263" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.283323] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08b0a134-0b8b-408a-b05b-a7ca32208263',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.423193] env[65136]: INFO networking_nsxv3.common.synchronization [req-ff9e0cad-66b4-4fbc-a0de-b7ac22374db7 req-47a781f2-8435-4564-97c3-70634e5ab390 service nova] Enqueued Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_rules [ 654.423193] env[65136]: INFO networking_nsxv3.common.synchronization [req-ff9e0cad-66b4-4fbc-a0de-b7ac22374db7 req-47a781f2-8435-4564-97c3-70634e5ab390 service nova] Enqueued Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_members [ 654.423193] env[65136]: INFO networking_nsxv3.common.synchronization [req-ff9e0cad-66b4-4fbc-a0de-b7ac22374db7 req-47a781f2-8435-4564-97c3-70634e5ab390 service nova] Enqueued Resource ID: 917d8d0e-294c-42e0-95a9-4ce305517dc4 with Priority: HIGHEST for action port [ 654.423193] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_rules [ 654.423193] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_members [ 654.423193] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 917d8d0e-294c-42e0-95a9-4ce305517dc4 with Priority: HIGHEST for action port [ 654.423620] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-39322202-687d-409e-86ef-4870f36135e8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.424016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.424186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.424473] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.424682] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.425920] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-39322202-687d-409e-86ef-4870f36135e8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.426029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.426253] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-917d8d0e-294c-42e0-95a9-4ce305517dc4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.426351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-917d8d0e-294c-42e0-95a9-4ce305517dc4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.426411] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-917d8d0e-294c-42e0-95a9-4ce305517dc4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.426684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-917d8d0e-294c-42e0-95a9-4ce305517dc4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.426684] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('917d8d0e-294c-42e0-95a9-4ce305517dc4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.448038] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.448218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.448324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.448513] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.448605] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.450056] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.450257] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.450330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.450512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.450597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.450690] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 is going to be updated. [ 654.483567] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.483972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.483972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.484133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.484281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.493955] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 in Status: IN_PROGRESS for 2s [ 654.669912] env[65136]: INFO networking_nsxv3.common.synchronization [None req-a09cf676-ccb6-47a7-9cf0-8354cfa848fd None None] Enqueued Resource ID: f28d6419-96cf-4d36-aa67-d9141c883865 with Priority: HIGHEST for action port [ 654.670648] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f28d6419-96cf-4d36-aa67-d9141c883865 with Priority: HIGHEST for action port [ 654.671020] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-f28d6419-96cf-4d36-aa67-d9141c883865 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.671152] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f28d6419-96cf-4d36-aa67-d9141c883865" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.671229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f28d6419-96cf-4d36-aa67-d9141c883865" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.671526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f28d6419-96cf-4d36-aa67-d9141c883865" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.671604] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f28d6419-96cf-4d36-aa67-d9141c883865',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.725025] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d789ffc8-c337-422a-bd53-59d582b7cf8f: rpc.has_security_group_logging(os_id): False [ 654.741784] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.742059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.742059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.742809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.742809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.742809] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.742809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.742809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.743150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.743150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.743150] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.743270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.743270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.743498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.743498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.743660] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.743750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.743812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.743952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.744137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.744174] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d789ffc8-c337-422a-bd53-59d582b7cf8f is going to be created. [ 654.788052] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08b0a134-0b8b-408a-b05b-a7ca32208263 [ 654.788190] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.788696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.788696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.788696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.788696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.788696] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08b0a134-0b8b-408a-b05b-a7ca32208263 already deleted. [ 654.790397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08b0a134-0b8b-408a-b05b-a7ca32208263" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.814471] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.814471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.814721] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.814838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.814959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.834944] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d789ffc8-c337-422a-bd53-59d582b7cf8f in Status: IN_PROGRESS for 2s [ 654.929549] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-39322202-687d-409e-86ef-4870f36135e8 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.929703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.930335] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 917d8d0e-294c-42e0-95a9-4ce305517dc4 with status ACTIVE [ 654.930521] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.930640] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.930710] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.930925] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.931064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.931258] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.931380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.931506] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.931616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.931710] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.931902] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.932068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.932142] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.932279] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.932361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.932480] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 917d8d0e-294c-42e0-95a9-4ce305517dc4 is going to be updated. [ 654.973028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.973608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.973608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.973608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.973752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.973867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-917d8d0e-294c-42e0-95a9-4ce305517dc4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.174076] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f28d6419-96cf-4d36-aa67-d9141c883865 [ 655.174695] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.174695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.174695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.176439] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.176439] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.176439] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f28d6419-96cf-4d36-aa67-d9141c883865 already deleted. [ 655.176439] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f28d6419-96cf-4d36-aa67-d9141c883865" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.249677] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39322202-687d-409e-86ef-4870f36135e8 in Status: SUCCESS [ 656.250319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.251077] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.251077] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.251178] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.251390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.251483] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.251664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.252173] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.252173] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.418243] env[65136]: INFO networking_nsxv3.common.synchronization [None req-95190577-cd15-41bd-89be-1e2cdaa97161 None None] Enqueued Resource ID: 393428c1-bb62-4a83-8458-cdb55c43b8b8 with Priority: HIGHEST for action port [ 656.418243] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 393428c1-bb62-4a83-8458-cdb55c43b8b8 with Priority: HIGHEST for action port [ 656.418243] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-393428c1-bb62-4a83-8458-cdb55c43b8b8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.418243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-393428c1-bb62-4a83-8458-cdb55c43b8b8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.418243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-393428c1-bb62-4a83-8458-cdb55c43b8b8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.418243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-393428c1-bb62-4a83-8458-cdb55c43b8b8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.418243] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('393428c1-bb62-4a83-8458-cdb55c43b8b8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.504805] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 in Status: SUCCESS [ 656.505069] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 deletion is rescheduled due to dependency. [ 656.505229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.755274] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.852880] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d789ffc8-c337-422a-bd53-59d582b7cf8f in Status: SUCCESS [ 656.853122] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.915338] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 393428c1-bb62-4a83-8458-cdb55c43b8b8 [ 656.915338] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.915501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.915542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.916174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.917363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.917363] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:393428c1-bb62-4a83-8458-cdb55c43b8b8 already deleted. [ 656.917363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-393428c1-bb62-4a83-8458-cdb55c43b8b8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.258296] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.763902] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.763902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.763902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.763902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.763902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.763902] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39322202-687d-409e-86ef-4870f36135e8 is going to be updated. [ 657.806576] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.806576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.806972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.806972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.807124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.812022] env[65136]: INFO networking_nsxv3.common.synchronization [None req-998c5a12-e364-468d-bb45-5711ba20dc88 None None] Enqueued Resource ID: fedba32c-0167-4225-ad42-4cd8b09ea6e8 with Priority: HIGHEST for action port [ 657.812022] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fedba32c-0167-4225-ad42-4cd8b09ea6e8 with Priority: HIGHEST for action port [ 657.813917] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-fedba32c-0167-4225-ad42-4cd8b09ea6e8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.813917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fedba32c-0167-4225-ad42-4cd8b09ea6e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.813917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fedba32c-0167-4225-ad42-4cd8b09ea6e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.813917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fedba32c-0167-4225-ad42-4cd8b09ea6e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.813917] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fedba32c-0167-4225-ad42-4cd8b09ea6e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.822417] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39322202-687d-409e-86ef-4870f36135e8 in Status: IN_PROGRESS for 2s [ 658.291781] env[65136]: INFO networking_nsxv3.common.synchronization [req-92cc92e0-afa3-4a6d-90d4-1ffdbb40f6b8 req-d31d447e-4db7-4368-9c75-9d34e06be517 tempest-ServerDiagnosticsTest-3268279 tempest-ServerDiagnosticsTest-3268279-project-member] Enqueued Resource ID: dbb8b9b9-cf98-4843-a063-345334ac585b with Priority: HIGHEST for action security_group_members [ 658.292263] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbb8b9b9-cf98-4843-a063-345334ac585b with Priority: HIGHEST for action security_group_members [ 658.292561] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbb8b9b9-cf98-4843-a063-345334ac585b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.292705] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.292748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.294041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.294154] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.294224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.294324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.294465] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.294555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.294645] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbb8b9b9-cf98-4843-a063-345334ac585b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.320161] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fedba32c-0167-4225-ad42-4cd8b09ea6e8 [ 658.320161] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.320161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.320161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.320161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.320161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.320559] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fedba32c-0167-4225-ad42-4cd8b09ea6e8 already deleted. [ 658.320559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fedba32c-0167-4225-ad42-4cd8b09ea6e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.484460] env[65136]: INFO networking_nsxv3.common.synchronization [None req-adfecd2c-ed4d-4481-9b38-13b81bd928e5 None None] Enqueued Resource ID: 7030c965-e4ff-4e63-a7ed-a9bca35eac0a with Priority: HIGHEST for action port [ 658.485285] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7030c965-e4ff-4e63-a7ed-a9bca35eac0a with Priority: HIGHEST for action port [ 658.485816] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-7030c965-e4ff-4e63-a7ed-a9bca35eac0a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.486188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7030c965-e4ff-4e63-a7ed-a9bca35eac0a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.486362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7030c965-e4ff-4e63-a7ed-a9bca35eac0a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.486705] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7030c965-e4ff-4e63-a7ed-a9bca35eac0a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.486906] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7030c965-e4ff-4e63-a7ed-a9bca35eac0a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.797337] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.797511] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.797575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.797796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.797888] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.798128] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.798228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.798284] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.798441] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.798512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.798597] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbb8b9b9-cf98-4843-a063-345334ac585b already deleted. [ 658.798677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.829025] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.830633] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.830633] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.830633] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.830633] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.830633] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.831031] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.832287] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.832287] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.832287] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.832486] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.832486] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.832576] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.832680] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.832778] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.832902] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.887011] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.887266] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.054 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 658.888048] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.888048] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.888048] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-4e15ca08-b60d-4daa-b70f-e15b68d54c40 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.888281] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-4e15ca08-b60d-4daa-b70f-e15b68d54c40" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.888348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-4e15ca08-b60d-4daa-b70f-e15b68d54c40" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.888654] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-4e15ca08-b60d-4daa-b70f-e15b68d54c40" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.892231] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e15ca08-b60d-4daa-b70f-e15b68d54c40',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.989483] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7030c965-e4ff-4e63-a7ed-a9bca35eac0a [ 658.989727] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.989870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.989941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.990248] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.990371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.990873] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7030c965-e4ff-4e63-a7ed-a9bca35eac0a already deleted. [ 658.991028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7030c965-e4ff-4e63-a7ed-a9bca35eac0a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.396385] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.396835] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.396835] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.397067] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.397235] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.397393] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 4e15ca08-b60d-4daa-b70f-e15b68d54c40 not found, creating... [ 659.397670] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.397832] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.397970] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.398210] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.398348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.398708] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.398829] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.399020] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.402189] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.402189] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.402189] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 4e15ca08-b60d-4daa-b70f-e15b68d54c40 is going to be created. [ 659.424370] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.424901] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.424901] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.425135] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.425453] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.425723] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-4e15ca08-b60d-4daa-b70f-e15b68d54c40" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.834734] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39322202-687d-409e-86ef-4870f36135e8 in Status: SUCCESS [ 659.835205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.835486] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.836152] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.836152] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.836382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.836527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.836791] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.836882] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.837018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.837814] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.193508] env[65136]: INFO networking_nsxv3.common.synchronization [req-92cc92e0-afa3-4a6d-90d4-1ffdbb40f6b8 req-fbf5c841-16af-462b-9cb1-a96e547f9fde service nova] Enqueued Resource ID: dbb8b9b9-cf98-4843-a063-345334ac585b with Priority: HIGHEST for action security_group_rules [ 660.193688] env[65136]: INFO networking_nsxv3.common.synchronization [req-92cc92e0-afa3-4a6d-90d4-1ffdbb40f6b8 req-fbf5c841-16af-462b-9cb1-a96e547f9fde service nova] Enqueued Resource ID: dbb8b9b9-cf98-4843-a063-345334ac585b with Priority: HIGHEST for action security_group_members [ 660.193888] env[65136]: INFO networking_nsxv3.common.synchronization [req-92cc92e0-afa3-4a6d-90d4-1ffdbb40f6b8 req-fbf5c841-16af-462b-9cb1-a96e547f9fde service nova] Enqueued Resource ID: 4e15ca08-b60d-4daa-b70f-e15b68d54c40 with Priority: HIGHEST for action port [ 660.194353] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbb8b9b9-cf98-4843-a063-345334ac585b with Priority: HIGHEST for action security_group_rules [ 660.194492] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbb8b9b9-cf98-4843-a063-345334ac585b with Priority: HIGHEST for action security_group_members [ 660.194593] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e15ca08-b60d-4daa-b70f-e15b68d54c40 with Priority: HIGHEST for action port [ 660.194868] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbb8b9b9-cf98-4843-a063-345334ac585b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.195168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.195168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.195382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.195468] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbb8b9b9-cf98-4843-a063-345334ac585b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.196719] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbb8b9b9-cf98-4843-a063-345334ac585b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.196828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.196909] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.197089] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.197238] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.197332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.197393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.197537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.197621] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.197713] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbb8b9b9-cf98-4843-a063-345334ac585b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.199780] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e15ca08-b60d-4daa-b70f-e15b68d54c40 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.199780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e15ca08-b60d-4daa-b70f-e15b68d54c40" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.199780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e15ca08-b60d-4daa-b70f-e15b68d54c40" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.199780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e15ca08-b60d-4daa-b70f-e15b68d54c40" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.199780] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e15ca08-b60d-4daa-b70f-e15b68d54c40',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.340655] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-39322202-687d-409e-86ef-4870f36135e8 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.340907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.340907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.341179] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.341413] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.341500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.341578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.341755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.341855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.341961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.342144] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-39322202-687d-409e-86ef-4870f36135e8 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.342241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.342305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.342469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.342619] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.342718] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.342786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.342970] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.343089] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.343250] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.343358] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.703684] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbb8b9b9-cf98-4843-a063-345334ac585b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.704492] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.704492] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dbb8b9b9-cf98-4843-a063-345334ac585b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.705550] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e15ca08-b60d-4daa-b70f-e15b68d54c40 with status ACTIVE [ 660.705661] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.705803] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.707782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.709511] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.709511] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.709813] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.709890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.709969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.710240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.710344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.711986] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.712701] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.712937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.713906] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.714087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.714377] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e15ca08-b60d-4daa-b70f-e15b68d54c40 is going to be updated. [ 660.743430] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.743619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.744521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.744521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.744669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.746275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e15ca08-b60d-4daa-b70f-e15b68d54c40" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.782482] env[65136]: INFO networking_nsxv3.common.synchronization [req-baaf8338-1fa8-4885-b80f-fdb31cc05c5d req-e7704236-9654-4961-b04f-93a5037677b4 tempest-DeleteServersTestJSON-1045367082 tempest-DeleteServersTestJSON-1045367082-project-member] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 660.783480] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 660.783848] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.783975] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.784055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.784359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.784857] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.785110] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.785110] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.785283] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.785421] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.785536] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.845859] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 39322202-687d-409e-86ef-4870f36135e8: rpc.has_security_group_logging(os_id): False [ 660.871665] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.871946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.872176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.872386] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.872484] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.872847] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.872847] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.872955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.873038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.873125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.873308] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.873449] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.873525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.873675] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.873774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.873985] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.874100] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.874161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.874745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.874866] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.874931] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 39322202-687d-409e-86ef-4870f36135e8 is going to be updated. [ 660.952555] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.952732] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.952866] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.953103] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.953282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.966837] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39322202-687d-409e-86ef-4870f36135e8 in Status: IN_PROGRESS for 2s [ 661.035524] env[65136]: INFO networking_nsxv3.common.synchronization [None req-a64ca3db-52b3-4adb-8c3a-652df5d279cd None None] Enqueued Resource ID: b78b6a96-1d0f-4686-a920-7ade690ddd92 with Priority: HIGHEST for action port [ 661.035988] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b78b6a96-1d0f-4686-a920-7ade690ddd92 with Priority: HIGHEST for action port [ 661.036336] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-b78b6a96-1d0f-4686-a920-7ade690ddd92 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.037138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b78b6a96-1d0f-4686-a920-7ade690ddd92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.037138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b78b6a96-1d0f-4686-a920-7ade690ddd92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.037138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b78b6a96-1d0f-4686-a920-7ade690ddd92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.037138] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b78b6a96-1d0f-4686-a920-7ade690ddd92',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.218309] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dbb8b9b9-cf98-4843-a063-345334ac585b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.288506] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.290436] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.290647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.291073] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.291189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.291492] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.291630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.291711] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.291907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.292030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.292131] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 already deleted. [ 661.292229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.515986] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.516243] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.516370] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.516713] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.517620] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.517951] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.519696] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.520085] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.524270] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.524525] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.524644] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.524753] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.524861] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.524963] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.525072] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.525214] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.538730] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b78b6a96-1d0f-4686-a920-7ade690ddd92 [ 661.539278] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.539559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.539623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.539958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.540409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.543747] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b78b6a96-1d0f-4686-a920-7ade690ddd92 already deleted. [ 661.543747] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b78b6a96-1d0f-4686-a920-7ade690ddd92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.560556] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.560556] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 661.560556] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.560556] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.560920] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-eac73988-ee99-4241-bcdd-0bc460701711 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.560920] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-eac73988-ee99-4241-bcdd-0bc460701711" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.561089] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-eac73988-ee99-4241-bcdd-0bc460701711" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.561362] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-eac73988-ee99-4241-bcdd-0bc460701711" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.561487] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eac73988-ee99-4241-bcdd-0bc460701711',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.722430] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.722430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.722430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.722791] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.722791] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.722791] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbb8b9b9-cf98-4843-a063-345334ac585b is going to be created. [ 661.752383] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.752383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.752383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.752656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.752764] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.765027] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbb8b9b9-cf98-4843-a063-345334ac585b in Status: UNINITIALIZED for 2s [ 661.874087] env[65136]: INFO networking_nsxv3.common.synchronization [None req-44df33bb-6da3-4d25-8b52-a7ebe50cb042 None None] Enqueued Resource ID: 7591692e-abe9-4429-a539-aaf3c3ebcd39 with Priority: HIGHEST for action port [ 661.875270] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7591692e-abe9-4429-a539-aaf3c3ebcd39 with Priority: HIGHEST for action port [ 661.875842] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-7591692e-abe9-4429-a539-aaf3c3ebcd39 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.876266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7591692e-abe9-4429-a539-aaf3c3ebcd39" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.876336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7591692e-abe9-4429-a539-aaf3c3ebcd39" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.876883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7591692e-abe9-4429-a539-aaf3c3ebcd39" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.876883] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7591692e-abe9-4429-a539-aaf3c3ebcd39',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.067524] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.068573] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.068573] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.070458] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.070656] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.070832] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port eac73988-ee99-4241-bcdd-0bc460701711 not found, creating... [ 662.071509] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.071509] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.071509] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.074348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.074348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.074348] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.074348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.074348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.074348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.074348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.074348] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: eac73988-ee99-4241-bcdd-0bc460701711 is going to be created. [ 662.098809] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.098809] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.099041] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.099284] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.099645] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.099738] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-eac73988-ee99-4241-bcdd-0bc460701711" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.380063] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7591692e-abe9-4429-a539-aaf3c3ebcd39 [ 662.380400] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.380400] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.380509] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.380621] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.380712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.380811] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7591692e-abe9-4429-a539-aaf3c3ebcd39 already deleted. [ 662.380898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7591692e-abe9-4429-a539-aaf3c3ebcd39" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.874617] env[65136]: INFO networking_nsxv3.common.synchronization [req-baaf8338-1fa8-4885-b80f-fdb31cc05c5d req-d1a7bb17-0a55-4967-97fa-693475d2361f service nova] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_rules [ 662.874617] env[65136]: INFO networking_nsxv3.common.synchronization [req-baaf8338-1fa8-4885-b80f-fdb31cc05c5d req-d1a7bb17-0a55-4967-97fa-693475d2361f service nova] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 662.874617] env[65136]: INFO networking_nsxv3.common.synchronization [req-baaf8338-1fa8-4885-b80f-fdb31cc05c5d req-d1a7bb17-0a55-4967-97fa-693475d2361f service nova] Enqueued Resource ID: eac73988-ee99-4241-bcdd-0bc460701711 with Priority: HIGHEST for action port [ 662.877378] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_rules [ 662.877378] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 662.877378] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eac73988-ee99-4241-bcdd-0bc460701711 with Priority: HIGHEST for action port [ 662.877718] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.877861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.877946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.878266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.878661] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.879823] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.879823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.879823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.879823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.879986] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.886325] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.886325] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.886325] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.886325] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.886325] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.887047] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-eac73988-ee99-4241-bcdd-0bc460701711 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.887047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eac73988-ee99-4241-bcdd-0bc460701711" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.887232] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eac73988-ee99-4241-bcdd-0bc460701711" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.887387] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eac73988-ee99-4241-bcdd-0bc460701711" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.887479] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eac73988-ee99-4241-bcdd-0bc460701711',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.989390] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 39322202-687d-409e-86ef-4870f36135e8 in Status: SUCCESS [ 662.989390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.391588] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.391588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.391588] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.393332] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eac73988-ee99-4241-bcdd-0bc460701711 with status ACTIVE [ 663.393735] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.393735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.393894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.394523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.394523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.394523] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.394523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.394523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.394764] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.394764] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.394946] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.395086] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.395153] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.395299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.395374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.395458] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eac73988-ee99-4241-bcdd-0bc460701711 is going to be updated. [ 663.421928] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.422214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.422370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.422641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.422842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.423314] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eac73988-ee99-4241-bcdd-0bc460701711" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.543273] env[65136]: INFO networking_nsxv3.common.synchronization [req-9da0609a-eaa8-4da4-a189-f650a0466215 req-df5e8363-e2ed-407f-9609-1ef64f23dbe4 tempest-DeleteServersAdminTestJSON-1450577537 tempest-DeleteServersAdminTestJSON-1450577537-project-member] Enqueued Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_members [ 663.543863] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_members [ 663.545653] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c713a5b4-d91d-4c9c-8670-3e057521cf54 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.545742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.545742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.546192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.547757] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.547757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.547757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.548165] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.548165] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.548238] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.774795] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbb8b9b9-cf98-4843-a063-345334ac585b in Status: SUCCESS [ 663.775009] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.775296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.775397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.775732] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.775732] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.775926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.776097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.776097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.776209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.776379] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dbb8b9b9-cf98-4843-a063-345334ac585b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.898265] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.050632] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.050892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.050892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.051185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.051288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.051491] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.051621] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.051683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.052062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.052062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.052178] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 is going to be updated. [ 664.088072] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.088072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.088072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.088072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.088072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.101775] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 in Status: IN_PROGRESS for 2s [ 664.174225] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.174736] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.175054] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.176921] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.176921] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.176921] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.176921] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.179040] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.179040] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.179040] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.179040] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.179040] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.179040] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.179040] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.179040] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.179040] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.205165] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.205418] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 664.205418] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.205576] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.205998] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-83bd463d-9d51-434c-a328-66e7bcbca63f taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.206301] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-83bd463d-9d51-434c-a328-66e7bcbca63f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.206301] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-83bd463d-9d51-434c-a328-66e7bcbca63f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.206631] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-83bd463d-9d51-434c-a328-66e7bcbca63f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.206754] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83bd463d-9d51-434c-a328-66e7bcbca63f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.279638] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbb8b9b9-cf98-4843-a063-345334ac585b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.280181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.280181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.280181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.280372] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.280478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.280547] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.280697] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.280788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.280879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.281040] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbb8b9b9-cf98-4843-a063-345334ac585b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.281138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.281202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.281348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.281486] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.281577] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.281639] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.281776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.281856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.281941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.282051] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dbb8b9b9-cf98-4843-a063-345334ac585b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.286370] env[65136]: INFO networking_nsxv3.common.synchronization [None req-0579be5d-5461-4f5b-a205-0c58e1ced79e None None] Enqueued Resource ID: 52749e3c-9491-4130-b82c-296ff3e019c4 with Priority: HIGHEST for action port [ 664.287386] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52749e3c-9491-4130-b82c-296ff3e019c4 with Priority: HIGHEST for action port [ 664.287733] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-52749e3c-9491-4130-b82c-296ff3e019c4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.287859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52749e3c-9491-4130-b82c-296ff3e019c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.288039] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52749e3c-9491-4130-b82c-296ff3e019c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.288324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52749e3c-9491-4130-b82c-296ff3e019c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.288434] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52749e3c-9491-4130-b82c-296ff3e019c4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.404018] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.404018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.404018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.404018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.404018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.404018] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be created. [ 664.429032] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.429032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.429032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.429032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.429032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.437445] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: UNINITIALIZED for 2s [ 664.710678] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.710988] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.710988] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.711393] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.711555] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.711685] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 83bd463d-9d51-434c-a328-66e7bcbca63f not found, creating... [ 664.711948] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.712144] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.712251] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.712477] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.712605] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.712890] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.715024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.715226] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.715496] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.715632] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.715799] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 83bd463d-9d51-434c-a328-66e7bcbca63f is going to be created. [ 664.732038] env[65136]: INFO networking_nsxv3.common.synchronization [req-ba51b68c-58de-44dc-86e3-fef8347f88d6 req-adbdd99c-c3dc-4540-bfb6-efa8fde96c89 tempest-ServerDiagnosticsNegativeTest-276633888 tempest-ServerDiagnosticsNegativeTest-276633888-project-member] Enqueued Resource ID: 7f41536b-89cc-4053-984d-cc435f2aab48 with Priority: HIGHEST for action security_group_members [ 664.732667] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f41536b-89cc-4053-984d-cc435f2aab48 with Priority: HIGHEST for action security_group_members [ 664.733660] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f41536b-89cc-4053-984d-cc435f2aab48 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.733660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.733660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.733660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.733932] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.734039] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.734131] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.734356] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.735455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.735455] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f41536b-89cc-4053-984d-cc435f2aab48',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.746341] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.746636] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.746803] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.747197] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.747505] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.748134] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-83bd463d-9d51-434c-a328-66e7bcbca63f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.785382] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dbb8b9b9-cf98-4843-a063-345334ac585b: rpc.has_security_group_logging(os_id): False [ 664.797404] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 52749e3c-9491-4130-b82c-296ff3e019c4 [ 664.797655] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.797822] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.797892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.798233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.798334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.798429] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:52749e3c-9491-4130-b82c-296ff3e019c4 already deleted. [ 664.798594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52749e3c-9491-4130-b82c-296ff3e019c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.807501] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.807753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.807857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.808362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.808362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.808533] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.808633] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.808689] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.808862] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.808952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.809154] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.809253] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.809423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.809489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.809569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.809751] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.809842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.809976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.810164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.810280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.810354] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbb8b9b9-cf98-4843-a063-345334ac585b is going to be created. [ 664.916569] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.918755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.918755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.918755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.918755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.936962] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbb8b9b9-cf98-4843-a063-345334ac585b in Status: IN_PROGRESS for 2s [ 665.237596] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.237760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.237835] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.238164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.238288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.239106] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.239300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.239461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.239621] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.239621] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.239690] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f41536b-89cc-4053-984d-cc435f2aab48 is going to be updated. [ 665.284341] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.284341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.284341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.284341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.284341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.310209] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f41536b-89cc-4053-984d-cc435f2aab48 in Status: IN_PROGRESS for 2s [ 665.455699] env[65136]: INFO networking_nsxv3.common.synchronization [req-9da0609a-eaa8-4da4-a189-f650a0466215 req-280bc82e-3487-4dfa-ba92-dca735c1e77e service nova] Enqueued Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_rules [ 665.456077] env[65136]: INFO networking_nsxv3.common.synchronization [req-9da0609a-eaa8-4da4-a189-f650a0466215 req-280bc82e-3487-4dfa-ba92-dca735c1e77e service nova] Enqueued Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_members [ 665.456191] env[65136]: INFO networking_nsxv3.common.synchronization [req-9da0609a-eaa8-4da4-a189-f650a0466215 req-280bc82e-3487-4dfa-ba92-dca735c1e77e service nova] Enqueued Resource ID: 83bd463d-9d51-434c-a328-66e7bcbca63f with Priority: HIGHEST for action port [ 665.457532] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_rules [ 665.457703] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_members [ 665.457841] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83bd463d-9d51-434c-a328-66e7bcbca63f with Priority: HIGHEST for action port [ 665.458206] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c713a5b4-d91d-4c9c-8670-3e057521cf54 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.458386] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.458483] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.458722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.458835] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.459813] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c713a5b4-d91d-4c9c-8670-3e057521cf54 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.460042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.460189] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-83bd463d-9d51-434c-a328-66e7bcbca63f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.460313] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83bd463d-9d51-434c-a328-66e7bcbca63f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.460400] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83bd463d-9d51-434c-a328-66e7bcbca63f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.460706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83bd463d-9d51-434c-a328-66e7bcbca63f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.460772] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83bd463d-9d51-434c-a328-66e7bcbca63f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.963207] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c713a5b4-d91d-4c9c-8670-3e057521cf54 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.963585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.963585] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83bd463d-9d51-434c-a328-66e7bcbca63f with status ACTIVE [ 665.963729] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.963836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.963900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.964556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.964556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.968885] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.968885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.968885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.968885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.968885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.968885] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.968885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.968885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.968885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.968885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.968885] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83bd463d-9d51-434c-a328-66e7bcbca63f is going to be updated. [ 665.992150] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.992347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.992407] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.993188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.995186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.995616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83bd463d-9d51-434c-a328-66e7bcbca63f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.113677] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 in Status: SUCCESS [ 666.114485] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 deletion is rescheduled due to dependency. [ 666.114485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.114485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.114485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.114485] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.114746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.114746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.114746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.114865] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.114912] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.451563] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 666.451805] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.452034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.452324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.452515] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.452641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.452707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.452866] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.452985] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.453102] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.453232] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.620189] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.857982] env[65136]: INFO networking_nsxv3.common.synchronization [req-a10cf599-acbe-4d3e-b812-504085ed0a35 req-018b7b67-56bd-4f1a-923d-01db27515bf8 tempest-SecurityGroupRulesNegativeTestJSON-701564705 tempest-SecurityGroupRulesNegativeTestJSON-701564705-project-member] Enqueued Resource ID: fd912571-bc8e-4fb4-80a8-002d5eea3723 with Priority: HIGHEST for action security_group_rules [ 666.858925] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd912571-bc8e-4fb4-80a8-002d5eea3723 with Priority: HIGHEST for action security_group_rules [ 666.860700] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd912571-bc8e-4fb4-80a8-002d5eea3723 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.860931] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd912571-bc8e-4fb4-80a8-002d5eea3723" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.861097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd912571-bc8e-4fb4-80a8-002d5eea3723" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.861458] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd912571-bc8e-4fb4-80a8-002d5eea3723" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.861810] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd912571-bc8e-4fb4-80a8-002d5eea3723',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.958066] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dbb8b9b9-cf98-4843-a063-345334ac585b in Status: SUCCESS [ 666.958066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.958066] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.958066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.958066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.958066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.958066] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.958066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.958066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.959133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.959489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.959699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.959967] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.960215] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.960415] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.961686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.961686] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.961686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.961686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.961686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.961686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.961686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.961686] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.123788] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.324275] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f41536b-89cc-4053-984d-cc435f2aab48 in Status: SUCCESS [ 667.325733] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f41536b-89cc-4053-984d-cc435f2aab48 deletion is rescheduled due to dependency. [ 667.325733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.389800] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.390059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.390189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.390523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.390716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.390867] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd912571-bc8e-4fb4-80a8-002d5eea3723 already deleted. [ 667.391016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd912571-bc8e-4fb4-80a8-002d5eea3723" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.464471] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5ef8f7d-8350-4fe2-9bef-70ff70b5f141: rpc.has_security_group_logging(os_id): False [ 667.486945] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.487266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.487403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.487711] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.487855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.488486] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.488486] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.488486] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.489078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.489245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.489546] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.489702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.489802] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.490398] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.490398] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.490544] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.490619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.490693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.490910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.491118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.491183] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be created. [ 667.595227] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.595339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.595412] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.595633] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.595972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.612934] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 667.627678] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.628108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.628233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.628489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.628604] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.628712] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 is going to be updated. [ 667.667270] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.667270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.667270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.667473] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.667514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.682444] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 in Status: IN_PROGRESS for 2s [ 667.769445] env[65136]: INFO networking_nsxv3.common.synchronization [None req-1013c12c-816a-44d9-9d2d-dee958758a1c None None] Enqueued Resource ID: 7533acab-dc21-49e0-b1a7-4bb4d28088b0 with Priority: HIGHEST for action port [ 667.770292] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7533acab-dc21-49e0-b1a7-4bb4d28088b0 with Priority: HIGHEST for action port [ 667.771589] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-7533acab-dc21-49e0-b1a7-4bb4d28088b0 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.771790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7533acab-dc21-49e0-b1a7-4bb4d28088b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.771858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7533acab-dc21-49e0-b1a7-4bb4d28088b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.772589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7533acab-dc21-49e0-b1a7-4bb4d28088b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.772709] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7533acab-dc21-49e0-b1a7-4bb4d28088b0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.276345] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7533acab-dc21-49e0-b1a7-4bb4d28088b0 [ 668.278225] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.278363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.278363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.278630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.278765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.278950] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7533acab-dc21-49e0-b1a7-4bb4d28088b0 already deleted. [ 668.279048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7533acab-dc21-49e0-b1a7-4bb4d28088b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.333294] env[65136]: INFO networking_nsxv3.common.synchronization [req-c77f30aa-8d1b-45f7-a08c-846016c3f560 req-6514c740-7232-4cdf-818a-2304b7348411 tempest-ServersV294TestFqdnHostnames-1024632663 tempest-ServersV294TestFqdnHostnames-1024632663-project-member] Enqueued Resource ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d with Priority: HIGHEST for action security_group_members [ 668.334198] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d with Priority: HIGHEST for action security_group_members [ 668.335219] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.335346] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.335488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.335882] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.335951] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.336138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.336224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.336391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.336506] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.336639] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5640a309-d0fa-4870-9eee-f2caeb1f4b8d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.778466] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-134 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.778673] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-134" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.778746] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-134" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.779205] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-134" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.780129] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.780129] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.780129] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.780365] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.780524] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.780985] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.781124] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.785191] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.785191] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.785191] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.785191] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.785191] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.809692] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.809933] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 668.810100] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.810536] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-134" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.810904] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-9230e2d9-c4d6-4196-b718-83a7046d5ac3 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.811250] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-9230e2d9-c4d6-4196-b718-83a7046d5ac3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.811391] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-9230e2d9-c4d6-4196-b718-83a7046d5ac3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.811861] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-9230e2d9-c4d6-4196-b718-83a7046d5ac3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.812480] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9230e2d9-c4d6-4196-b718-83a7046d5ac3',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.841882] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.842138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.842215] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.842786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.842786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.842786] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.842786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.843091] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.843091] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.843091] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.843192] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d already deleted. [ 668.843256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.315087] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.315430] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.315536] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.315792] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.315950] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.316092] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 9230e2d9-c4d6-4196-b718-83a7046d5ac3 not found, creating... [ 669.316730] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.316867] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.316993] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.317275] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.317414] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.317760] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.318110] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.318283] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.318632] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.319759] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.319759] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 9230e2d9-c4d6-4196-b718-83a7046d5ac3 is going to be created. [ 669.327100] env[65136]: INFO networking_nsxv3.common.synchronization [req-17af5a6f-f69b-4362-ad47-57a5a4ef3bfb req-e6da1a70-029f-4b88-a9de-854826800d31 tempest-ServerExternalEventsTest-847490909 tempest-ServerExternalEventsTest-847490909-project-member] Enqueued Resource ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd with Priority: HIGHEST for action security_group_members [ 669.328048] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd with Priority: HIGHEST for action security_group_members [ 669.328387] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.328498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.328572] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.328788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.329042] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.329157] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.329240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.329437] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.329562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.329619] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.342605] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.342787] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.342787] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.343561] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.343561] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.343561] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-9230e2d9-c4d6-4196-b718-83a7046d5ac3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.629674] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 669.629916] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.695496] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 in Status: SUCCESS [ 669.695496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.695496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.695496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.695496] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.695496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.695496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.695832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.695832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.695832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.695832] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.832482] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.832718] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.832970] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.833177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.833355] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.833660] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.833789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.833887] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.834157] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.834373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.834455] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd is going to be updated. [ 669.865794] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.866090] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.866184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.866524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.866750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.878143] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd in Status: IN_PROGRESS for 2s [ 670.113628] env[65136]: INFO networking_nsxv3.common.synchronization [req-c77f30aa-8d1b-45f7-a08c-846016c3f560 req-80574f12-141c-499a-9ea7-736a58917c1f service nova] Enqueued Resource ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d with Priority: HIGHEST for action security_group_rules [ 670.113628] env[65136]: INFO networking_nsxv3.common.synchronization [req-c77f30aa-8d1b-45f7-a08c-846016c3f560 req-80574f12-141c-499a-9ea7-736a58917c1f service nova] Enqueued Resource ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d with Priority: HIGHEST for action security_group_members [ 670.113628] env[65136]: INFO networking_nsxv3.common.synchronization [req-c77f30aa-8d1b-45f7-a08c-846016c3f560 req-80574f12-141c-499a-9ea7-736a58917c1f service nova] Enqueued Resource ID: 9230e2d9-c4d6-4196-b718-83a7046d5ac3 with Priority: HIGHEST for action port [ 670.114724] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d with Priority: HIGHEST for action security_group_rules [ 670.115088] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d with Priority: HIGHEST for action security_group_members [ 670.115269] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9230e2d9-c4d6-4196-b718-83a7046d5ac3 with Priority: HIGHEST for action port [ 670.117738] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5640a309-d0fa-4870-9eee-f2caeb1f4b8d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.117850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.118058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.118403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.118605] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5640a309-d0fa-4870-9eee-f2caeb1f4b8d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.120068] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.120311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.120415] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.120719] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.120926] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.121195] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.121332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.123176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.123276] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.123381] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5640a309-d0fa-4870-9eee-f2caeb1f4b8d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.124446] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-9230e2d9-c4d6-4196-b718-83a7046d5ac3 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.125181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9230e2d9-c4d6-4196-b718-83a7046d5ac3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.125181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9230e2d9-c4d6-4196-b718-83a7046d5ac3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.126271] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9230e2d9-c4d6-4196-b718-83a7046d5ac3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.126417] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9230e2d9-c4d6-4196-b718-83a7046d5ac3',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.199662] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c713a5b4-d91d-4c9c-8670-3e057521cf54 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.199904] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.199997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.200255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.201261] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.201261] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.201261] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.201261] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.201261] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.201261] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.201629] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c713a5b4-d91d-4c9c-8670-3e057521cf54 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.201629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.201629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.201761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.205017] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.205017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.205017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.205017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.205017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.205017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.205017] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.615809] env[65136]: INFO networking_nsxv3.common.synchronization [None req-38f95fe6-dd57-47c3-827a-fcd36a03c8cc None None] Enqueued Resource ID: a75c55d4-85de-4399-92c4-97e8a2adeffa with Priority: HIGHEST for action port [ 670.616527] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a75c55d4-85de-4399-92c4-97e8a2adeffa with Priority: HIGHEST for action port [ 670.616864] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-a75c55d4-85de-4399-92c4-97e8a2adeffa taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.616999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a75c55d4-85de-4399-92c4-97e8a2adeffa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.617384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a75c55d4-85de-4399-92c4-97e8a2adeffa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.617704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a75c55d4-85de-4399-92c4-97e8a2adeffa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.618452] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a75c55d4-85de-4399-92c4-97e8a2adeffa',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.629375] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5640a309-d0fa-4870-9eee-f2caeb1f4b8d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.632899] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.633278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.633278] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9230e2d9-c4d6-4196-b718-83a7046d5ac3 with status ACTIVE [ 670.635427] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.635663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.635708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.635925] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.636593] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.636712] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.636849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.636920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.637150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.637193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.637450] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.637506] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.637542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.637698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.637754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.637829] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9230e2d9-c4d6-4196-b718-83a7046d5ac3 is going to be updated. [ 670.666209] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.666372] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.666439] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.666659] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.668138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.668138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9230e2d9-c4d6-4196-b718-83a7046d5ac3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.705078] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c713a5b4-d91d-4c9c-8670-3e057521cf54: rpc.has_security_group_logging(os_id): False [ 670.726869] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.727032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.727105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.727347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.727438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.728480] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.728480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.728480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.728480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.728480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.728807] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.728807] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.728807] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.728960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.729070] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.729353] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.729470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.729580] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.729838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.729838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.729986] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 is going to be updated. [ 670.814751] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.814992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.814992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.815210] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.817575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.833096] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 in Status: IN_PROGRESS for 2s [ 671.122209] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a75c55d4-85de-4399-92c4-97e8a2adeffa [ 671.122209] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.122209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.122209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.122209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.122209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.122209] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a75c55d4-85de-4399-92c4-97e8a2adeffa already deleted. [ 671.122209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a75c55d4-85de-4399-92c4-97e8a2adeffa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.135836] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5640a309-d0fa-4870-9eee-f2caeb1f4b8d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.641025] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.642173] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.642173] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.642173] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.642173] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.642173] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d is going to be created. [ 671.668473] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.668663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.668794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.668931] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.669839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.682294] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d in Status: UNINITIALIZED for 2s [ 671.813628] env[65136]: INFO networking_nsxv3.common.synchronization [None req-93376593-439c-4b5b-99ae-ec620b90b659 None None] Enqueued Resource ID: c39e7bd5-d579-4fc8-ab82-b81eb841e40d with Priority: HIGHEST for action port [ 671.814049] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c39e7bd5-d579-4fc8-ab82-b81eb841e40d with Priority: HIGHEST for action port [ 671.814330] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-c39e7bd5-d579-4fc8-ab82-b81eb841e40d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.814467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c39e7bd5-d579-4fc8-ab82-b81eb841e40d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.814599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c39e7bd5-d579-4fc8-ab82-b81eb841e40d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.814786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c39e7bd5-d579-4fc8-ab82-b81eb841e40d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.814866] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c39e7bd5-d579-4fc8-ab82-b81eb841e40d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.851492] env[65136]: INFO networking_nsxv3.common.synchronization [req-011d5b72-a1e8-474b-b2a6-6a26a56d3e39 req-900206e0-8cf8-48c7-9c98-22b4b21338cf tempest-SecurityGroupRulesNegativeTestJSON-701564705 tempest-SecurityGroupRulesNegativeTestJSON-701564705-project-member] Enqueued Resource ID: fd912571-bc8e-4fb4-80a8-002d5eea3723 with Priority: HIGHEST for action security_group_rules [ 671.852130] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd912571-bc8e-4fb4-80a8-002d5eea3723 with Priority: HIGHEST for action security_group_rules [ 671.852838] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd912571-bc8e-4fb4-80a8-002d5eea3723 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.852838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd912571-bc8e-4fb4-80a8-002d5eea3723" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.852838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd912571-bc8e-4fb4-80a8-002d5eea3723" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.853493] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd912571-bc8e-4fb4-80a8-002d5eea3723" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.853493] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd912571-bc8e-4fb4-80a8-002d5eea3723',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.894197] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd in Status: SUCCESS [ 671.894369] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd deletion is rescheduled due to dependency. [ 671.894560] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.319077] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c39e7bd5-d579-4fc8-ab82-b81eb841e40d [ 672.319933] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.320133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.322035] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.322610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.322610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.322610] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c39e7bd5-d579-4fc8-ab82-b81eb841e40d already deleted. [ 672.322610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c39e7bd5-d579-4fc8-ab82-b81eb841e40d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.379043] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.379306] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.379392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.379711] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.379870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.380056] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd912571-bc8e-4fb4-80a8-002d5eea3723 already deleted. [ 672.380339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd912571-bc8e-4fb4-80a8-002d5eea3723" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.850626] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 in Status: SUCCESS [ 672.850626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.354586] env[65136]: INFO networking_nsxv3.common.synchronization [req-7a4d291b-127b-400c-9e78-dfdee010e0e1 req-5bbda51f-4184-41f8-926a-f430d74f0a0e tempest-ServersAdminTestJSON-92432023 tempest-ServersAdminTestJSON-92432023-project-member] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 673.354846] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 673.355169] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.355293] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.355362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.355624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.355773] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.355882] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.355953] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.357295] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.357679] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.357847] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.690843] env[65136]: INFO networking_nsxv3.common.synchronization [req-191ed8cc-4d9f-49fa-9799-aa4bbc20201e req-e695d37a-ffe6-4385-b2cd-f78f8a562c83 tempest-VolumesAdminNegativeTest-1818602586 tempest-VolumesAdminNegativeTest-1818602586-project-member] Enqueued Resource ID: 4b70c67f-c559-421c-8bdc-2943731f1140 with Priority: HIGHEST for action security_group_members [ 673.695753] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d in Status: SUCCESS [ 673.695753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.695753] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b70c67f-c559-421c-8bdc-2943731f1140 with Priority: HIGHEST for action security_group_members [ 673.695753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.695753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.695753] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.696200] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.697095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.697095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.698186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.698404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.698404] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5640a309-d0fa-4870-9eee-f2caeb1f4b8d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.699411] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b70c67f-c559-421c-8bdc-2943731f1140 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.702022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.702022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.702022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.702022] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.702022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.702022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.702022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.702022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.702022] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b70c67f-c559-421c-8bdc-2943731f1140',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.863068] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.863068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.863068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.863068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.863068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.863559] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.863559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.863559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.863688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.863688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.863761] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 171f535d-ebee-432f-b393-d063259af9b9 already deleted. [ 673.864855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.996509] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-718 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.996767] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.996767] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.997856] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.998239] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.998409] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.998546] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.998757] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.998917] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.999135] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 673.999490] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.000448] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.000448] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.000448] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.000448] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.000448] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.034463] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.034707] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 674.034831] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.035019] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.035469] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-5d4fbc88-c959-4c2b-b060-3fb54d713b9a taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.036134] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-5d4fbc88-c959-4c2b-b060-3fb54d713b9a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.036134] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-5d4fbc88-c959-4c2b-b060-3fb54d713b9a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.036460] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-5d4fbc88-c959-4c2b-b060-3fb54d713b9a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.036607] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d4fbc88-c959-4c2b-b060-3fb54d713b9a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.204228] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5640a309-d0fa-4870-9eee-f2caeb1f4b8d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.205378] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.205519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.205591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.205836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.205996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.206143] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.206249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.206334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.206492] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.206697] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.206697] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b70c67f-c559-421c-8bdc-2943731f1140 is going to be updated. [ 674.234373] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.234520] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.238070] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.238070] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.238070] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.245951] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b70c67f-c559-421c-8bdc-2943731f1140 in Status: IN_PROGRESS for 2s [ 674.462191] env[65136]: INFO networking_nsxv3.common.synchronization [None req-da19e324-7de1-40c1-bd30-3b7f32b35b9f None None] Enqueued Resource ID: a456881f-00e8-4280-ab74-aee012948c5f with Priority: HIGHEST for action port [ 674.462767] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a456881f-00e8-4280-ab74-aee012948c5f with Priority: HIGHEST for action port [ 674.463362] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-a456881f-00e8-4280-ab74-aee012948c5f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.463571] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a456881f-00e8-4280-ab74-aee012948c5f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.463571] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a456881f-00e8-4280-ab74-aee012948c5f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.463994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a456881f-00e8-4280-ab74-aee012948c5f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.463994] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a456881f-00e8-4280-ab74-aee012948c5f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.540829] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.541135] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.541281] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.541534] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.541759] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.541925] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 5d4fbc88-c959-4c2b-b060-3fb54d713b9a not found, creating... [ 674.542253] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.542441] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.542581] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.542849] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.542997] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.543585] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.543585] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.543751] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.543829] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.543986] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.544140] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 5d4fbc88-c959-4c2b-b060-3fb54d713b9a is going to be created. [ 674.568994] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.569268] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.569427] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.569711] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.569956] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.570235] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-5d4fbc88-c959-4c2b-b060-3fb54d713b9a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.709533] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5640a309-d0fa-4870-9eee-f2caeb1f4b8d: rpc.has_security_group_logging(os_id): False [ 674.736353] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.736565] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.736565] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.736786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.736869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.737120] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.737248] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.737320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.737479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.737597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.737738] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d is going to be created. [ 674.802400] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.802632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.802719] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.802962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.803169] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.818443] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d in Status: IN_PROGRESS for 2s [ 674.972684] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a456881f-00e8-4280-ab74-aee012948c5f [ 674.972938] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.973109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.973168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.973389] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.973482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.973582] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a456881f-00e8-4280-ab74-aee012948c5f already deleted. [ 674.973667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a456881f-00e8-4280-ab74-aee012948c5f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.396019] env[65136]: INFO networking_nsxv3.common.synchronization [req-7a4d291b-127b-400c-9e78-dfdee010e0e1 req-d10bc801-f5bf-4345-8d4a-608f391a3680 service nova] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_rules [ 675.396019] env[65136]: INFO networking_nsxv3.common.synchronization [req-7a4d291b-127b-400c-9e78-dfdee010e0e1 req-d10bc801-f5bf-4345-8d4a-608f391a3680 service nova] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 675.396412] env[65136]: INFO networking_nsxv3.common.synchronization [req-7a4d291b-127b-400c-9e78-dfdee010e0e1 req-d10bc801-f5bf-4345-8d4a-608f391a3680 service nova] Enqueued Resource ID: 5d4fbc88-c959-4c2b-b060-3fb54d713b9a with Priority: HIGHEST for action port [ 675.396733] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_rules [ 675.396870] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 675.396971] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d4fbc88-c959-4c2b-b060-3fb54d713b9a with Priority: HIGHEST for action port [ 675.400335] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.400496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.400567] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.400864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.401011] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.402493] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.402610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.402859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.404158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.404158] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.404158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.404158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.404158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.404158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.404158] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.405272] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d4fbc88-c959-4c2b-b060-3fb54d713b9a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.405272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d4fbc88-c959-4c2b-b060-3fb54d713b9a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.405272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d4fbc88-c959-4c2b-b060-3fb54d713b9a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.405272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d4fbc88-c959-4c2b-b060-3fb54d713b9a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.405272] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d4fbc88-c959-4c2b-b060-3fb54d713b9a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.456338] env[65136]: INFO networking_nsxv3.common.synchronization [req-876e89c2-bfb5-4475-96e1-2ab5b1956c65 req-fff2af17-dbd1-427b-a635-128b1c7ff61f tempest-InstanceActionsNegativeTestJSON-1249202560 tempest-InstanceActionsNegativeTestJSON-1249202560-project-member] Enqueued Resource ID: d789ffc8-c337-422a-bd53-59d582b7cf8f with Priority: HIGHEST for action security_group_members [ 675.457613] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d789ffc8-c337-422a-bd53-59d582b7cf8f with Priority: HIGHEST for action security_group_members [ 675.458255] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d789ffc8-c337-422a-bd53-59d582b7cf8f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.458461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.458588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.458956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.459225] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.459430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.459537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.459776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.459911] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.460125] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d789ffc8-c337-422a-bd53-59d582b7cf8f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.905295] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.909163] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d4fbc88-c959-4c2b-b060-3fb54d713b9a with status ACTIVE [ 675.909163] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.909163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.909163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.909163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.909163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.909163] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.909163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.909163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.909163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.909163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.909163] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.909163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.909163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.909163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.909163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.909790] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d4fbc88-c959-4c2b-b060-3fb54d713b9a is going to be updated. [ 675.910734] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.910883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.936469] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.936469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.937246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.937246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.937395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.937555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d4fbc88-c959-4c2b-b060-3fb54d713b9a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.966530] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.966796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.966870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.967092] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.967183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.967359] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.967555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.967555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.967810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.967810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.967910] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d789ffc8-c337-422a-bd53-59d582b7cf8f is going to be updated. [ 675.998171] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.998171] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.998171] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.998171] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.998171] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.009533] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d789ffc8-c337-422a-bd53-59d582b7cf8f in Status: IN_PROGRESS for 2s [ 676.255389] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b70c67f-c559-421c-8bdc-2943731f1140 in Status: SUCCESS [ 676.255962] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b70c67f-c559-421c-8bdc-2943731f1140 deletion is rescheduled due to dependency. [ 676.255962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.411860] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.835657] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d in Status: SUCCESS [ 676.835789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.918664] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.918664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.918664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.918664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.918664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.918664] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be created. [ 676.947818] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.948313] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.950018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.950018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.950018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.966493] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: UNINITIALIZED for 2s [ 678.022034] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d789ffc8-c337-422a-bd53-59d582b7cf8f in Status: SUCCESS [ 678.022711] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d789ffc8-c337-422a-bd53-59d582b7cf8f deletion is rescheduled due to dependency. [ 678.022903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.374686] env[65136]: INFO networking_nsxv3.common.synchronization [req-7f737268-b9fa-4f7f-9988-4336ecea47a5 req-4f4f778e-030b-438f-9c8f-a8f4f207818c tempest-ServersAdminTestJSON-92432023 tempest-ServersAdminTestJSON-92432023-project-member] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 678.374686] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 678.374686] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.374686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.981369] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 678.981617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.981804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.982040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.982283] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.982421] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.982490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.982669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.982756] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.982846] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.982946] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.984113] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.984679] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.984940] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.985134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.985261] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.985454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.985583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.985717] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.007030] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-718 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.007030] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.007030] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.007030] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.010766] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.011311] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.011688] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.012220] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.012600] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.014035] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.014035] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.014035] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.014035] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.014035] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.014035] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.014035] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.039756] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.040082] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 679.040195] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.041399] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.041399] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-2a0a4586-067a-487f-9466-55a39230d63d taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.041399] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-2a0a4586-067a-487f-9466-55a39230d63d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.041399] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-2a0a4586-067a-487f-9466-55a39230d63d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.041399] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-2a0a4586-067a-487f-9466-55a39230d63d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.041709] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a0a4586-067a-487f-9466-55a39230d63d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.151160] env[65136]: INFO networking_nsxv3.common.synchronization [None req-21937b28-eb9b-4e54-bb1d-099f108f1020 None None] Enqueued Resource ID: 78f9a244-ddd4-4a7c-b144-406bf9e633e8 with Priority: HIGHEST for action port [ 679.153596] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f9a244-ddd4-4a7c-b144-406bf9e633e8 with Priority: HIGHEST for action port [ 679.153596] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-78f9a244-ddd4-4a7c-b144-406bf9e633e8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.153596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78f9a244-ddd4-4a7c-b144-406bf9e633e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.153596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78f9a244-ddd4-4a7c-b144-406bf9e633e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.156848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78f9a244-ddd4-4a7c-b144-406bf9e633e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.156848] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78f9a244-ddd4-4a7c-b144-406bf9e633e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.487942] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.488182] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.488335] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.545795] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.546070] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.546200] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.546468] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.546613] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.546768] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 2a0a4586-067a-487f-9466-55a39230d63d not found, creating... [ 679.547034] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.547188] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.547300] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.547507] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.547636] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.547904] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.548080] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.548197] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.548401] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.548527] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.548673] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 2a0a4586-067a-487f-9466-55a39230d63d is going to be created. [ 679.568095] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.568572] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.568572] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.569049] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.569276] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.569582] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-2a0a4586-067a-487f-9466-55a39230d63d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.661790] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 78f9a244-ddd4-4a7c-b144-406bf9e633e8 [ 679.662116] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.662246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.662318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.662603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.662711] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.662812] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:78f9a244-ddd4-4a7c-b144-406bf9e633e8 already deleted. [ 679.663793] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78f9a244-ddd4-4a7c-b144-406bf9e633e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.991662] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.383933] env[65136]: INFO networking_nsxv3.common.synchronization [req-7f737268-b9fa-4f7f-9988-4336ecea47a5 req-0621d6be-1e98-4ba7-82ba-e634b9caaec8 service nova] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_rules [ 680.383933] env[65136]: INFO networking_nsxv3.common.synchronization [req-7f737268-b9fa-4f7f-9988-4336ecea47a5 req-0621d6be-1e98-4ba7-82ba-e634b9caaec8 service nova] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 680.383933] env[65136]: INFO networking_nsxv3.common.synchronization [req-7f737268-b9fa-4f7f-9988-4336ecea47a5 req-0621d6be-1e98-4ba7-82ba-e634b9caaec8 service nova] Enqueued Resource ID: 2a0a4586-067a-487f-9466-55a39230d63d with Priority: HIGHEST for action port [ 680.383933] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_rules [ 680.384611] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 680.384611] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a0a4586-067a-487f-9466-55a39230d63d with Priority: HIGHEST for action port [ 680.384877] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.385599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.386745] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.386874] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.387105] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a0a4586-067a-487f-9466-55a39230d63d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.387249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a0a4586-067a-487f-9466-55a39230d63d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.387342] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a0a4586-067a-487f-9466-55a39230d63d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.387558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a0a4586-067a-487f-9466-55a39230d63d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.387642] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a0a4586-067a-487f-9466-55a39230d63d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.496799] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.496966] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.497050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.497279] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.497365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.497462] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be updated. [ 680.530341] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.530587] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.530587] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.530800] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.530998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.545395] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: IN_PROGRESS for 2s [ 680.894822] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2a0a4586-067a-487f-9466-55a39230d63d with status ACTIVE [ 680.895974] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.896582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.896582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.896698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.896790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.897180] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.897259] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.897306] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.900130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.900130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.900130] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.900130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.900130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.900130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.900130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.900130] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2a0a4586-067a-487f-9466-55a39230d63d is going to be updated. [ 680.928131] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.928555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.928949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.929357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.931062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.931062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a0a4586-067a-487f-9466-55a39230d63d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.823787] env[65136]: INFO networking_nsxv3.common.synchronization [None req-33dff7e8-4d9d-4650-96bb-7d1cfee8e57e None None] Enqueued Resource ID: b6d6d131-23a4-4934-862b-f60fd745d95c with Priority: HIGHEST for action port [ 681.824355] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6d6d131-23a4-4934-862b-f60fd745d95c with Priority: HIGHEST for action port [ 681.824726] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6d6d131-23a4-4934-862b-f60fd745d95c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.824809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6d6d131-23a4-4934-862b-f60fd745d95c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.824848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6d6d131-23a4-4934-862b-f60fd745d95c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.825336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6d6d131-23a4-4934-862b-f60fd745d95c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.825859] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6d6d131-23a4-4934-862b-f60fd745d95c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.330266] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6d6d131-23a4-4934-862b-f60fd745d95c [ 682.330552] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.330699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.330777] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.331011] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.331106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.331208] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6d6d131-23a4-4934-862b-f60fd745d95c already deleted. [ 682.331319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6d6d131-23a4-4934-862b-f60fd745d95c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.399039] env[65136]: INFO networking_nsxv3.common.synchronization [None req-107d7b80-8acb-4ddf-b753-acde430b792f tempest-ServersTestJSON-750370346 tempest-ServersTestJSON-750370346-project-member] Enqueued Resource ID: 4450efc3-afd8-4465-8453-713d205d5684 with Priority: HIGHEST for action security_group_rules [ 682.399797] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4450efc3-afd8-4465-8453-713d205d5684 with Priority: HIGHEST for action security_group_rules [ 682.401871] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4450efc3-afd8-4465-8453-713d205d5684 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.401871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.401871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.401871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.401871] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4450efc3-afd8-4465-8453-713d205d5684',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.557517] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 682.557689] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.557861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.558326] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.558536] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.558694] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.558785] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.559107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.559208] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.559482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.559482] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.559618] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.559667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.559910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.560394] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.560859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.560859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.560859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.561051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.561188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.561350] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.562731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.562813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.562990] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.563267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.563267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.563386] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.563507] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.563672] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.707588] env[65136]: INFO networking_nsxv3.common.synchronization [None req-aa296b4c-f425-4702-8853-122c16391d04 tempest-ServersTestJSON-750370346 tempest-ServersTestJSON-750370346-project-member] Enqueued Resource ID: 4450efc3-afd8-4465-8453-713d205d5684 with Priority: HIGHEST for action security_group_rules [ 682.710310] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4450efc3-afd8-4465-8453-713d205d5684 with Priority: HIGHEST for action security_group_rules [ 682.710774] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4450efc3-afd8-4465-8453-713d205d5684 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.710947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.925266] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.925266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.925266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.925266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.925266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.925723] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4450efc3-afd8-4465-8453-713d205d5684 already deleted. [ 682.925723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.925723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.925920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.925920] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4450efc3-afd8-4465-8453-713d205d5684',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.065631] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 171f535d-ebee-432f-b393-d063259af9b9: rpc.has_security_group_logging(os_id): False [ 683.068851] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.089773] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.090055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.090186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.090559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.090713] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.090912] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.091217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.091217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.091336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.091336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.091999] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.091999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.091999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.091999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.091999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.092299] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.092299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.092299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.092975] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.092975] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.092975] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be created. [ 683.180768] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.180946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.180994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.181466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.181700] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.194564] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: IN_PROGRESS for 2s [ 683.278189] env[65136]: INFO networking_nsxv3.common.synchronization [req-da086cc3-3b16-4a2c-8016-b1a43f7d6342 req-76bb9209-5d46-4899-93d0-236cc47fa479 tempest-ServerActionsV293TestJSON-1327897741 tempest-ServerActionsV293TestJSON-1327897741-project-member] Enqueued Resource ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a with Priority: HIGHEST for action security_group_members [ 683.279847] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a with Priority: HIGHEST for action security_group_members [ 683.280366] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-837b8c63-6d80-45d3-a9be-427d83c5b42a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.280693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.280890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.281282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.281997] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.282290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.282629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.284281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.284281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.284281] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('837b8c63-6d80-45d3-a9be-427d83c5b42a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.453731] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.453731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.453731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.453731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.453731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.453731] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4450efc3-afd8-4465-8453-713d205d5684 already deleted. [ 683.453731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.571529] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.790088] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.790266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.790364] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.790740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.790874] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.791110] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.791226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.791300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.791536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.791642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.791762] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a already deleted. [ 683.791855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.793057] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-7 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.793246] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.793429] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.793964] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.794287] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.794461] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.794576] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.794795] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.794930] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.795157] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.795255] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.795358] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.795460] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.795561] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.795671] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.795833] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.816887] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.817151] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 683.817296] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.817474] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.817782] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-4309a64a-637a-4509-b426-9f24596f297a taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.817938] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-4309a64a-637a-4509-b426-9f24596f297a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.818289] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-4309a64a-637a-4509-b426-9f24596f297a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.818674] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-4309a64a-637a-4509-b426-9f24596f297a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.818856] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4309a64a-637a-4509-b426-9f24596f297a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.075719] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.076157] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.076157] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.076351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.076458] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.076665] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be updated. [ 684.108403] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.108610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.108725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.108915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.109083] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.114030] env[65136]: INFO networking_nsxv3.common.synchronization [None req-01f8c50d-9170-478d-83f4-b1f85f219824 None None] Enqueued Resource ID: f982b5a6-4ddb-4f14-9a09-7dca103fe562 with Priority: HIGHEST for action port [ 684.114030] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f982b5a6-4ddb-4f14-9a09-7dca103fe562 with Priority: HIGHEST for action port [ 684.114030] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-f982b5a6-4ddb-4f14-9a09-7dca103fe562 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.114346] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f982b5a6-4ddb-4f14-9a09-7dca103fe562" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.114346] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f982b5a6-4ddb-4f14-9a09-7dca103fe562" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.114549] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f982b5a6-4ddb-4f14-9a09-7dca103fe562" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.114657] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f982b5a6-4ddb-4f14-9a09-7dca103fe562',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.121402] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: IN_PROGRESS for 2s [ 684.322392] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.322667] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.322736] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.323048] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.323297] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.323343] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 4309a64a-637a-4509-b426-9f24596f297a not found, creating... [ 684.323608] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.323809] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.323891] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.324155] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.324316] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.324620] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.324776] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.324930] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.325125] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.325466] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.325466] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 4309a64a-637a-4509-b426-9f24596f297a is going to be created. [ 684.350308] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.351108] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.351108] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.351590] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.351662] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.352964] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-4309a64a-637a-4509-b426-9f24596f297a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.617466] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f982b5a6-4ddb-4f14-9a09-7dca103fe562 [ 684.617739] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.617901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.617971] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.618289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.618391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.618510] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f982b5a6-4ddb-4f14-9a09-7dca103fe562 already deleted. [ 684.618598] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f982b5a6-4ddb-4f14-9a09-7dca103fe562" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.769289] env[65136]: INFO networking_nsxv3.common.synchronization [req-f6c5d299-dcef-4146-b0e5-3369ff53e36a req-9c7f1b30-af6a-4316-b768-d9a2a95ea9fd tempest-DeleteServersTestJSON-1045367082 tempest-DeleteServersTestJSON-1045367082-project-member] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 684.769649] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 684.770066] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.770290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.772143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.772143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.772143] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.772143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.772143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.772143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.772143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.772143] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.266764] env[65136]: INFO networking_nsxv3.common.synchronization [req-da086cc3-3b16-4a2c-8016-b1a43f7d6342 req-b048e685-8dce-4c53-a946-ea091378c835 service nova] Enqueued Resource ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a with Priority: HIGHEST for action security_group_rules [ 685.268060] env[65136]: INFO networking_nsxv3.common.synchronization [req-da086cc3-3b16-4a2c-8016-b1a43f7d6342 req-b048e685-8dce-4c53-a946-ea091378c835 service nova] Enqueued Resource ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a with Priority: HIGHEST for action security_group_members [ 685.268287] env[65136]: INFO networking_nsxv3.common.synchronization [req-da086cc3-3b16-4a2c-8016-b1a43f7d6342 req-b048e685-8dce-4c53-a946-ea091378c835 service nova] Enqueued Resource ID: 4309a64a-637a-4509-b426-9f24596f297a with Priority: HIGHEST for action port [ 685.270606] env[65136]: INFO networking_nsxv3.common.synchronization [req-824f4687-2f7c-48f0-bdce-1cd482469c63 req-1e0f26d3-5a7a-4762-ba97-2ce5cd2d59af tempest-ServerTagsTestJSON-659517285 tempest-ServerTagsTestJSON-659517285-project-member] Enqueued Resource ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 with Priority: HIGHEST for action security_group_members [ 685.271669] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a with Priority: HIGHEST for action security_group_rules [ 685.272285] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4309a64a-637a-4509-b426-9f24596f297a with Priority: HIGHEST for action port [ 685.272285] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a with Priority: HIGHEST for action security_group_members [ 685.272285] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 with Priority: HIGHEST for action security_group_members [ 685.273671] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-837b8c63-6d80-45d3-a9be-427d83c5b42a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.273860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.274126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.274282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.274426] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('837b8c63-6d80-45d3-a9be-427d83c5b42a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.276712] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-4309a64a-637a-4509-b426-9f24596f297a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.276712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4309a64a-637a-4509-b426-9f24596f297a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.276712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4309a64a-637a-4509-b426-9f24596f297a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.276712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4309a64a-637a-4509-b426-9f24596f297a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.276712] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4309a64a-637a-4509-b426-9f24596f297a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.277509] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-837b8c63-6d80-45d3-a9be-427d83c5b42a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.277692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.277802] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.278097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.278733] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.278733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.278733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.279120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.279120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.279267] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('837b8c63-6d80-45d3-a9be-427d83c5b42a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.281238] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4016a6d9-0970-467e-9687-5ce3a39e3775 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.281238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.281382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.281582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.281807] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.281947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.282048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.282955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.282955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.282955] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4016a6d9-0970-467e-9687-5ce3a39e3775',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.285363] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 685.285541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.286177] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.286177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.286282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.286428] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.286516] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.286708] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.286922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.286971] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.287307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.287371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.287541] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 685.290999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.291357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.291357] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.334775] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.335391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.335391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.336081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.336220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.348149] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 685.404208] env[65136]: INFO networking_nsxv3.common.synchronization [req-53448f0c-8008-4560-aa63-0fe33e387b22 req-e3dfb807-62d0-4cfc-91a0-e19061456727 tempest-ServerDiagnosticsTest-3268279 tempest-ServerDiagnosticsTest-3268279-project-member] Enqueued Resource ID: dbb8b9b9-cf98-4843-a063-345334ac585b with Priority: HIGHEST for action security_group_members [ 685.404949] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbb8b9b9-cf98-4843-a063-345334ac585b with Priority: HIGHEST for action security_group_members [ 685.405057] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-dbb8b9b9-cf98-4843-a063-345334ac585b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.405263] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.405263] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.405411] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.405581] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.405679] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.405751] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.405901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.406047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.406109] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dbb8b9b9-cf98-4843-a063-345334ac585b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.576961] env[65136]: INFO networking_nsxv3.common.synchronization [req-1ec36e00-6054-4c44-ad5b-22cf4d107f94 req-b71fe854-b4e3-4a1a-8f1b-62f7c575f3b7 tempest-ImagesOneServerNegativeTestJSON-685255343 tempest-ImagesOneServerNegativeTestJSON-685255343-project-member] Enqueued Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 685.577577] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 685.577903] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.578238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.578238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.579954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.579954] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.579954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.579954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.579954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.579954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.579954] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.782810] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('837b8c63-6d80-45d3-a9be-427d83c5b42a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.784628] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-837b8c63-6d80-45d3-a9be-427d83c5b42a taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.784859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.786291] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4309a64a-637a-4509-b426-9f24596f297a with status ACTIVE [ 685.786477] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.786600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.786661] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.786936] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.787157] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.787789] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.788400] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.788400] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.788400] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.788400] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.788666] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.788725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.788761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.789053] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.789053] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.789226] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4309a64a-637a-4509-b426-9f24596f297a is going to be updated. [ 685.793149] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.793411] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.793411] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.793533] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.793604] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.793855] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.793944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.794021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.794150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.794239] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.794314] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 is going to be updated. [ 685.795447] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.795578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.812658] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.812658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.812658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.812658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.813038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.813038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4309a64a-637a-4509-b426-9f24596f297a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.828116] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.828116] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.828351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.828482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.828673] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.846084] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 in Status: IN_PROGRESS for 2s [ 685.911266] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.911266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.911266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.911266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.911266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.911266] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.911266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.911266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.911266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.911266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.911266] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbb8b9b9-cf98-4843-a063-345334ac585b is going to be updated. [ 685.927751] env[65136]: INFO networking_nsxv3.common.synchronization [req-4799ba39-c2a9-418f-8b6f-11b31a127772 req-a9fff9d9-a5db-4b4d-b649-1f7bbe93aefd tempest-ServersTestMultiNic-1831982173 tempest-ServersTestMultiNic-1831982173-project-member] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 685.928545] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 685.928869] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.929055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.930372] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.930689] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.930834] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.932051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.932147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.932319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.932412] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.932514] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.980451] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.980541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.980647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.980842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.981071] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.992633] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbb8b9b9-cf98-4843-a063-345334ac585b in Status: IN_PROGRESS for 2s [ 686.081698] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.081886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.081886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.082153] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.082269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.082574] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.082811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.082811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.082976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.083071] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.083180] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b is going to be updated. [ 686.120981] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.120981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.120981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.120981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.120981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.136536] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 686.136536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.136536] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: IN_PROGRESS for 2s [ 686.137492] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.139645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.139645] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.139645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.139645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.139645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.139645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.139645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.139645] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.287107] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('837b8c63-6d80-45d3-a9be-427d83c5b42a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.364677] env[65136]: INFO networking_nsxv3.common.synchronization [req-4799ba39-c2a9-418f-8b6f-11b31a127772 req-f1763322-75bf-4775-97fa-faefca91ca6f tempest-ServersTestMultiNic-1831982173 tempest-ServersTestMultiNic-1831982173-project-member] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 686.366077] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 686.368197] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.368197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.437949] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.437949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.437949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.437949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.437949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.437949] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.437949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.437949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.437949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.437949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.437949] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb already deleted. [ 686.437949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.437949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.439117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.439117] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.439117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.439117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.439117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.439117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.439117] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.531413] env[65136]: INFO networking_nsxv3.common.synchronization [None req-87d338b7-dae0-45ec-a514-43ef3258eeb1 None None] Enqueued Resource ID: 1c72df55-6b8e-46ab-9996-cd2340eafc6d with Priority: HIGHEST for action port [ 686.531413] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c72df55-6b8e-46ab-9996-cd2340eafc6d with Priority: HIGHEST for action port [ 686.531413] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c72df55-6b8e-46ab-9996-cd2340eafc6d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.531413] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c72df55-6b8e-46ab-9996-cd2340eafc6d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.531413] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c72df55-6b8e-46ab-9996-cd2340eafc6d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.533227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c72df55-6b8e-46ab-9996-cd2340eafc6d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.533227] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c72df55-6b8e-46ab-9996-cd2340eafc6d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.645353] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.645353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.645353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.645353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.645353] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.645353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.645353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.645353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.645353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.645353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.645353] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.647307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.647307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.647307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.647307] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.647307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.647307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.647307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.647307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.647307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.647307] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.790066] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.790343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.790343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.791467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.791467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.791467] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a is going to be created. [ 686.819053] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.819319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.819445] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.819743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.819987] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.833456] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a in Status: UNINITIALIZED for 2s [ 686.853219] env[65136]: INFO networking_nsxv3.common.synchronization [req-4799ba39-c2a9-418f-8b6f-11b31a127772 req-c109e215-ab82-48e7-8c91-23b5c0bf4910 tempest-ServersTestMultiNic-1831982173 tempest-ServersTestMultiNic-1831982173-project-member] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 686.854662] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 686.854979] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.855099] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.942628] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.942628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.942628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.942958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.942958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.943180] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.943400] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.943488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.943649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.943743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.943820] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb already deleted. [ 686.943895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.944056] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.944206] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.944351] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.944460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.944524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.945179] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.945179] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.945179] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.035524] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c72df55-6b8e-46ab-9996-cd2340eafc6d [ 687.035524] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.035780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.035780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.035982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.036073] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.036855] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c72df55-6b8e-46ab-9996-cd2340eafc6d already deleted. [ 687.036855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c72df55-6b8e-46ab-9996-cd2340eafc6d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.152286] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 171f535d-ebee-432f-b393-d063259af9b9: rpc.has_security_group_logging(os_id): False [ 687.173840] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.173840] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.173840] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.174091] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.174091] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.174454] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.174454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.174454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.174721] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.174721] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.175981] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.175981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.175981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.175981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.175981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.175981] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.175981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.175981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.175981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.175981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.175981] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be updated. [ 687.255510] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.255696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.255953] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.256233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.256479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.273920] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: IN_PROGRESS for 2s [ 687.290025] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.290025] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-863" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.290025] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-863" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.290025] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-863" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.290708] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.290942] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.291091] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.291362] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.291506] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.291721] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.291831] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.291944] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.292091] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.292205] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.292307] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.292436] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.323210] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.323402] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 687.326498] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.326498] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-863" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.326498] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-d980616d-c4a6-429a-bd8f-a8ed7801a948 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.326498] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-d980616d-c4a6-429a-bd8f-a8ed7801a948" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.326498] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-d980616d-c4a6-429a-bd8f-a8ed7801a948" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.326498] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-d980616d-c4a6-429a-bd8f-a8ed7801a948" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.326498] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d980616d-c4a6-429a-bd8f-a8ed7801a948',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.369219] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 687.369498] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 deletion is rescheduled due to dependency. [ 687.369818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.447787] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.449390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.449390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.449390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.449390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.449390] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.449390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.449390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.449854] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.449854] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.449854] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb already deleted. [ 687.449854] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.831550] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.831550] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.831550] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.832699] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.832699] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.832699] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port d980616d-c4a6-429a-bd8f-a8ed7801a948 not found, creating... [ 687.832699] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.833061] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.833061] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.833763] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.833763] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.833763] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.834215] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.834215] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.834215] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.835029] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.835029] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: d980616d-c4a6-429a-bd8f-a8ed7801a948 is going to be created. [ 687.858305] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 in Status: SUCCESS [ 687.858547] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 deletion is rescheduled due to dependency. [ 687.859270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.864079] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.864079] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.864079] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.864079] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.864478] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.865040] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-d980616d-c4a6-429a-bd8f-a8ed7801a948" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.005856] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dbb8b9b9-cf98-4843-a063-345334ac585b in Status: SUCCESS [ 688.006414] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dbb8b9b9-cf98-4843-a063-345334ac585b deletion is rescheduled due to dependency. [ 688.006414] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.149232] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: SUCCESS [ 688.149437] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b deletion is rescheduled due to dependency. [ 688.149547] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.583052] env[65136]: INFO networking_nsxv3.common.synchronization [req-4799ba39-c2a9-418f-8b6f-11b31a127772 req-544bb4b3-b3c2-4d09-bf26-9d85bb5964b4 service nova] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_rules [ 688.583377] env[65136]: INFO networking_nsxv3.common.synchronization [req-4799ba39-c2a9-418f-8b6f-11b31a127772 req-544bb4b3-b3c2-4d09-bf26-9d85bb5964b4 service nova] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 688.583377] env[65136]: INFO networking_nsxv3.common.synchronization [req-4799ba39-c2a9-418f-8b6f-11b31a127772 req-544bb4b3-b3c2-4d09-bf26-9d85bb5964b4 service nova] Enqueued Resource ID: d980616d-c4a6-429a-bd8f-a8ed7801a948 with Priority: HIGHEST for action port [ 688.583890] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_rules [ 688.584143] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 688.584324] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d980616d-c4a6-429a-bd8f-a8ed7801a948 with Priority: HIGHEST for action port [ 688.584848] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.585081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.585253] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.585731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.585855] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.586858] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.587132] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.587301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.587568] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.587806] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.587961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.588274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.588274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.588451] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.588763] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.589760] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-d980616d-c4a6-429a-bd8f-a8ed7801a948 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.589975] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d980616d-c4a6-429a-bd8f-a8ed7801a948" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.590149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d980616d-c4a6-429a-bd8f-a8ed7801a948" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.590455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d980616d-c4a6-429a-bd8f-a8ed7801a948" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.590596] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d980616d-c4a6-429a-bd8f-a8ed7801a948',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.844336] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a in Status: SUCCESS [ 688.844648] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.844848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.845225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.845460] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.845613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.845739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.846161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.846348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.846477] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.846602] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('837b8c63-6d80-45d3-a9be-427d83c5b42a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.093206] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.094284] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.094444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.094584] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d980616d-c4a6-429a-bd8f-a8ed7801a948 with status ACTIVE [ 689.094754] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.094900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.094998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.095150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.095235] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.095403] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.096207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.096207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.096207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.096207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.096207] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.097735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.097951] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.098236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.098360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.098562] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d980616d-c4a6-429a-bd8f-a8ed7801a948 is going to be updated. [ 689.130361] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.130361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.130361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.130361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.130361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.130361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d980616d-c4a6-429a-bd8f-a8ed7801a948" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.297450] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 689.297450] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.350887] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('837b8c63-6d80-45d3-a9be-427d83c5b42a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.604716] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.855069] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 837b8c63-6d80-45d3-a9be-427d83c5b42a: rpc.has_security_group_logging(os_id): False [ 689.876106] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.876106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.876106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.876106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.876106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.876106] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.876106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.876106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.876583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.876583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.876583] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a is going to be created. [ 689.923461] env[65136]: INFO networking_nsxv3.common.synchronization [req-d6abe5ea-9781-4c1b-beb7-fce20d6b3cc1 req-f7a9ad5f-0373-4744-b968-da358d60433c tempest-VolumesAssistedSnapshotsTest-1316243484 tempest-VolumesAssistedSnapshotsTest-1316243484-project-member] Enqueued Resource ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c with Priority: HIGHEST for action security_group_members [ 689.923947] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c with Priority: HIGHEST for action security_group_members [ 689.924267] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.924267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.924406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.924543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.924701] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.924796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.924859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.925020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.925323] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.925323] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3db224c-b3c3-47ed-ae74-91d6ec4d268c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.951314] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.951461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.951515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.951740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.952085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.967136] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a in Status: IN_PROGRESS for 2s [ 690.036687] env[65136]: INFO networking_nsxv3.common.synchronization [None req-7d330210-a16e-4aa9-b81c-9385709da065 None None] Enqueued Resource ID: aa4b2153-b6c3-4f36-adfb-70b88a3d77fa with Priority: HIGHEST for action port [ 690.037434] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4b2153-b6c3-4f36-adfb-70b88a3d77fa with Priority: HIGHEST for action port [ 690.037747] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa4b2153-b6c3-4f36-adfb-70b88a3d77fa taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.037872] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa4b2153-b6c3-4f36-adfb-70b88a3d77fa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.037955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa4b2153-b6c3-4f36-adfb-70b88a3d77fa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.038267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa4b2153-b6c3-4f36-adfb-70b88a3d77fa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.038350] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa4b2153-b6c3-4f36-adfb-70b88a3d77fa',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.107209] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.110030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.110030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.110030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.110030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.110030] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be created. [ 690.142369] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.143016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.143424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.143797] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.145485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.159908] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: UNINITIALIZED for 2s [ 690.428177] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.428375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.428375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.430644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.430644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.430644] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.430644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.430644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.430644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.430644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.430644] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c is going to be updated. [ 690.443063] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-698 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.443063] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-698" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.443063] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-698" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.443721] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-698" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.443721] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.443940] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.443940] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.444143] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.444284] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.444501] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.444590] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.444700] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.444797] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.444900] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.444997] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.445135] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.470167] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.470167] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 690.470167] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.470352] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-698" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.470699] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-dfade2c6-07d7-4c5d-8f95-7dc90c4f728c taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.470872] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-dfade2c6-07d7-4c5d-8f95-7dc90c4f728c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.470986] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-dfade2c6-07d7-4c5d-8f95-7dc90c4f728c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.471348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-dfade2c6-07d7-4c5d-8f95-7dc90c4f728c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.471482] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfade2c6-07d7-4c5d-8f95-7dc90c4f728c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.474132] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.474470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.474470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.474633] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.474695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.489465] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c in Status: IN_PROGRESS for 2s [ 690.540261] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aa4b2153-b6c3-4f36-adfb-70b88a3d77fa [ 690.540508] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.540955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.540955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.540955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.541156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.541549] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aa4b2153-b6c3-4f36-adfb-70b88a3d77fa already deleted. [ 690.541657] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa4b2153-b6c3-4f36-adfb-70b88a3d77fa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.977173] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.977682] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.977851] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.978276] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.978478] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.979088] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port dfade2c6-07d7-4c5d-8f95-7dc90c4f728c not found, creating... [ 690.979557] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.979767] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.979911] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.980149] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.980311] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.980642] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.980815] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.980941] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.981176] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.981310] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.981488] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: dfade2c6-07d7-4c5d-8f95-7dc90c4f728c is going to be created. [ 691.018418] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.019244] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.019244] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.019244] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.019435] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.019573] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-dfade2c6-07d7-4c5d-8f95-7dc90c4f728c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.800025] env[65136]: INFO networking_nsxv3.common.synchronization [req-4799ba39-c2a9-418f-8b6f-11b31a127772 req-525fcad7-2d9c-4d55-8e95-e22153988079 service nova] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_rules [ 691.800025] env[65136]: INFO networking_nsxv3.common.synchronization [req-4799ba39-c2a9-418f-8b6f-11b31a127772 req-525fcad7-2d9c-4d55-8e95-e22153988079 service nova] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 691.800025] env[65136]: INFO networking_nsxv3.common.synchronization [req-4799ba39-c2a9-418f-8b6f-11b31a127772 req-525fcad7-2d9c-4d55-8e95-e22153988079 service nova] Enqueued Resource ID: dfade2c6-07d7-4c5d-8f95-7dc90c4f728c with Priority: HIGHEST for action port [ 691.800025] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_rules [ 691.800025] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 691.800025] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfade2c6-07d7-4c5d-8f95-7dc90c4f728c with Priority: HIGHEST for action port [ 691.800622] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.800739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.804196] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.804196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.804196] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfade2c6-07d7-4c5d-8f95-7dc90c4f728c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.804196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfade2c6-07d7-4c5d-8f95-7dc90c4f728c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.804196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfade2c6-07d7-4c5d-8f95-7dc90c4f728c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.804196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfade2c6-07d7-4c5d-8f95-7dc90c4f728c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.804196] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfade2c6-07d7-4c5d-8f95-7dc90c4f728c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.001457] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a in Status: SUCCESS [ 692.001457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.173042] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 692.173709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.174030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.175812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.175812] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.175812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.175812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.177073] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.177280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.178046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.178046] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.180430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.180430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.180430] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.180430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.180430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.180430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.180430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.180430] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.306410] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfade2c6-07d7-4c5d-8f95-7dc90c4f728c with status ACTIVE [ 692.306660] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.307046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.307046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.307149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.307220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.307407] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.307505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.307567] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.307722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.307798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.308123] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.308244] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.308321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.308473] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.308550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.308636] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfade2c6-07d7-4c5d-8f95-7dc90c4f728c is going to be updated. [ 692.348550] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.349765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.349897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.350168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.350357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.350559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfade2c6-07d7-4c5d-8f95-7dc90c4f728c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.514856] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c in Status: SUCCESS [ 692.515687] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c deletion is rescheduled due to dependency. [ 692.516137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.685043] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.685222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.685432] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.699372] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.699634] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-863" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.699782] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-863" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.700146] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-863" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.700526] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.700984] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.700984] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.701098] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.701196] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.701402] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.701507] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.701607] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.701705] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.701820] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.701987] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.702232] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.729452] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.729631] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 692.729770] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.729944] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-863" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.730573] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-43c0a6af-7e0a-40ff-8986-fc1cef5dd630 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.730678] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-43c0a6af-7e0a-40ff-8986-fc1cef5dd630" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.730831] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-43c0a6af-7e0a-40ff-8986-fc1cef5dd630" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.731175] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-43c0a6af-7e0a-40ff-8986-fc1cef5dd630" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.731309] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43c0a6af-7e0a-40ff-8986-fc1cef5dd630',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.818170] env[65136]: INFO networking_nsxv3.common.synchronization [None req-1b7d121d-5756-4bb1-9e67-9b5ef2a0be1d None None] Enqueued Resource ID: 1ce6b5fd-fc1c-4662-852a-78dae763cf72 with Priority: HIGHEST for action port [ 692.818795] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ce6b5fd-fc1c-4662-852a-78dae763cf72 with Priority: HIGHEST for action port [ 692.819200] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ce6b5fd-fc1c-4662-852a-78dae763cf72 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.819317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ce6b5fd-fc1c-4662-852a-78dae763cf72" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.819444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ce6b5fd-fc1c-4662-852a-78dae763cf72" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.819699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ce6b5fd-fc1c-4662-852a-78dae763cf72" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.819784] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ce6b5fd-fc1c-4662-852a-78dae763cf72',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.108302] env[65136]: INFO networking_nsxv3.common.synchronization [req-34667aa4-9770-4913-a608-d7cfb44ea470 req-ab416575-675d-4ba9-b5e3-f24619d33923 tempest-DeleteServersAdminTestJSON-1450577537 tempest-DeleteServersAdminTestJSON-1450577537-project-member] Enqueued Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_members [ 693.108302] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGHEST for action security_group_members [ 693.108895] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c713a5b4-d91d-4c9c-8670-3e057521cf54 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.108895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.108895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.109914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.109914] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.109914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.109914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.109914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.109914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.109914] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.190466] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.234471] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.234471] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.234633] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.235994] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.235994] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.235994] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 43c0a6af-7e0a-40ff-8986-fc1cef5dd630 not found, creating... [ 693.235994] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.235994] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.235994] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.236312] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.236312] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.237039] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.237039] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.237039] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.237039] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.238181] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.238181] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 43c0a6af-7e0a-40ff-8986-fc1cef5dd630 is going to be created. [ 693.263667] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.264408] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.264408] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.264408] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.264530] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.264773] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-43c0a6af-7e0a-40ff-8986-fc1cef5dd630" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.322153] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ce6b5fd-fc1c-4662-852a-78dae763cf72 [ 693.322391] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.322529] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.322600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.322828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.322914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.323189] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ce6b5fd-fc1c-4662-852a-78dae763cf72 already deleted. [ 693.323438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ce6b5fd-fc1c-4662-852a-78dae763cf72" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.612865] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.613068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.613136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.613353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.613448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.613645] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.613747] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.613833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.613955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.614046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.614136] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 is going to be updated. [ 693.646690] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.646824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.646944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.647597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.647597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.656776] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 in Status: IN_PROGRESS for 2s [ 693.693612] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.693612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.693612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.693612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.693612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.693779] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be updated. [ 693.726077] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.726232] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.726303] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.726507] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.726643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.739093] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 693.983814] env[65136]: INFO networking_nsxv3.common.synchronization [req-4799ba39-c2a9-418f-8b6f-11b31a127772 req-3afbba88-e5c2-436b-a353-e3816899c9d8 service nova] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_rules [ 693.984010] env[65136]: INFO networking_nsxv3.common.synchronization [req-4799ba39-c2a9-418f-8b6f-11b31a127772 req-3afbba88-e5c2-436b-a353-e3816899c9d8 service nova] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 693.984153] env[65136]: INFO networking_nsxv3.common.synchronization [req-4799ba39-c2a9-418f-8b6f-11b31a127772 req-3afbba88-e5c2-436b-a353-e3816899c9d8 service nova] Enqueued Resource ID: 43c0a6af-7e0a-40ff-8986-fc1cef5dd630 with Priority: HIGHEST for action port [ 693.984674] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_rules [ 693.984817] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 693.984916] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43c0a6af-7e0a-40ff-8986-fc1cef5dd630 with Priority: HIGHEST for action port [ 693.988682] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.988682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.988682] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.988682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.988682] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-43c0a6af-7e0a-40ff-8986-fc1cef5dd630 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.988682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43c0a6af-7e0a-40ff-8986-fc1cef5dd630" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.988682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43c0a6af-7e0a-40ff-8986-fc1cef5dd630" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.988682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43c0a6af-7e0a-40ff-8986-fc1cef5dd630" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.988682] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43c0a6af-7e0a-40ff-8986-fc1cef5dd630',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.490685] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43c0a6af-7e0a-40ff-8986-fc1cef5dd630 with status ACTIVE [ 694.490941] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.490941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.491047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.491860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.491860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.491860] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.491860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.491860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.491860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.491860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.492095] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.492154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.492218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.492353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.492422] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.492503] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43c0a6af-7e0a-40ff-8986-fc1cef5dd630 is going to be updated. [ 694.518858] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.519058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.519121] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.519333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.519466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.519655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43c0a6af-7e0a-40ff-8986-fc1cef5dd630" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.811124] env[65136]: INFO networking_nsxv3.common.synchronization [None req-d5a6e43d-f7e4-4610-8775-1e796e63e812 tempest-MigrationsAdminTest-368591407 tempest-MigrationsAdminTest-368591407-project-member] Enqueued Resource ID: 3555b5a3-c2c6-4066-a8c7-8d7c28638daa with Priority: HIGHEST for action security_group_rules [ 694.811861] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3555b5a3-c2c6-4066-a8c7-8d7c28638daa with Priority: HIGHEST for action security_group_rules [ 694.812280] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3555b5a3-c2c6-4066-a8c7-8d7c28638daa taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.812451] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3555b5a3-c2c6-4066-a8c7-8d7c28638daa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.812544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3555b5a3-c2c6-4066-a8c7-8d7c28638daa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.812883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3555b5a3-c2c6-4066-a8c7-8d7c28638daa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.813016] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3555b5a3-c2c6-4066-a8c7-8d7c28638daa',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.997874] env[65136]: INFO networking_nsxv3.common.synchronization [None req-0b56d068-8d0d-49f4-807c-8c12c684e9d1 tempest-MigrationsAdminTest-368591407 tempest-MigrationsAdminTest-368591407-project-member] Enqueued Resource ID: 3555b5a3-c2c6-4066-a8c7-8d7c28638daa with Priority: HIGHEST for action security_group_rules [ 694.998153] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3555b5a3-c2c6-4066-a8c7-8d7c28638daa with Priority: HIGHEST for action security_group_rules [ 694.998365] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3555b5a3-c2c6-4066-a8c7-8d7c28638daa taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.998467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3555b5a3-c2c6-4066-a8c7-8d7c28638daa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.338349] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.338654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.338654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.338800] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.338843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.338931] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3555b5a3-c2c6-4066-a8c7-8d7c28638daa already deleted. [ 695.339371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3555b5a3-c2c6-4066-a8c7-8d7c28638daa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.339640] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3555b5a3-c2c6-4066-a8c7-8d7c28638daa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.339804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3555b5a3-c2c6-4066-a8c7-8d7c28638daa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.339943] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3555b5a3-c2c6-4066-a8c7-8d7c28638daa',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.684441] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 in Status: SUCCESS [ 695.684441] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 deletion is rescheduled due to dependency. [ 695.685044] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.761580] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 695.762645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.762645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.762781] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.763099] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.764052] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.764052] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.764052] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.764052] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.764052] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.764309] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.765027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.765027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.765027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.765027] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.765027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.765027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.765027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.765027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.765513] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.765513] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.766252] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.766368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.766534] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.766632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.766691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.767569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.767569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.767569] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.868293] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.868583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.868628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.869085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.869085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.869085] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3555b5a3-c2c6-4066-a8c7-8d7c28638daa already deleted. [ 695.869197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3555b5a3-c2c6-4066-a8c7-8d7c28638daa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.073217] env[65136]: INFO networking_nsxv3.common.synchronization [None req-d7119aa4-442b-4e45-b374-641d971577d8 None None] Enqueued Resource ID: a3841af6-a672-4327-8aae-b2b4fe359d56 with Priority: HIGHEST for action port [ 696.074196] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3841af6-a672-4327-8aae-b2b4fe359d56 with Priority: HIGHEST for action port [ 696.074273] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3841af6-a672-4327-8aae-b2b4fe359d56 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.074392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3841af6-a672-4327-8aae-b2b4fe359d56" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.074480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3841af6-a672-4327-8aae-b2b4fe359d56" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.074691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3841af6-a672-4327-8aae-b2b4fe359d56" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.074769] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3841af6-a672-4327-8aae-b2b4fe359d56',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.271030] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7767bb26-265a-4c1f-9c68-9bd50a08bacb: rpc.has_security_group_logging(os_id): False [ 696.271905] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.291838] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.291970] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.292055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.292403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.292403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.292559] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.292656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.292722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.292866] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.292940] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.293126] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.293220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.293283] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.293429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.293500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.293688] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.293780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.293843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.293979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.294137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.294178] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be created. [ 696.368162] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.368326] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.368399] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.368638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.368852] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.384479] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 696.579784] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3841af6-a672-4327-8aae-b2b4fe359d56 [ 696.579784] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.579784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.579784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.579784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.579784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.579784] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3841af6-a672-4327-8aae-b2b4fe359d56 already deleted. [ 696.579784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3841af6-a672-4327-8aae-b2b4fe359d56" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.774654] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.276979] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.277241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.277241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.277463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.277668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.277668] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be updated. [ 697.313930] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.314086] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.314159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.314463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.314539] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.326546] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 697.642153] env[65136]: INFO networking_nsxv3.common.synchronization [req-63431dcb-9d6c-478d-9576-476f0178c4eb req-3bc8793c-eb62-4ff7-be45-628d15b59060 tempest-ServerDiskConfigTestJSON-1818502390 tempest-ServerDiskConfigTestJSON-1818502390-project-member] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 697.642153] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 697.642153] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.642153] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.642153] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.642153] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.642879] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.643134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.643329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.643600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.643793] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.645625] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.146312] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.146682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.146682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.146761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.146875] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.147030] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.147117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.147181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.147329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.147403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.147512] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d already deleted. [ 698.147569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.399189] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 698.399526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.399715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.399922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.400017] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.528409] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.528409] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.528409] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.528709] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.528959] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.529230] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.529348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.529555] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.529691] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.529896] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.530013] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.530114] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.530251] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.530394] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.530503] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.530630] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.549110] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.549265] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 698.549400] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.549568] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.549875] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-d18371ed-6194-4c0c-ba38-eb6cee0489c1 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.550046] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-d18371ed-6194-4c0c-ba38-eb6cee0489c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.550163] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-d18371ed-6194-4c0c-ba38-eb6cee0489c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.550485] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-d18371ed-6194-4c0c-ba38-eb6cee0489c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.550612] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d18371ed-6194-4c0c-ba38-eb6cee0489c1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.903390] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.903390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.977587] env[65136]: INFO networking_nsxv3.common.synchronization [None req-663770b3-f4ba-4498-b509-d42e1fe46c7e None None] Enqueued Resource ID: 289147c7-72c9-462d-b93d-0ae1bad6bcef with Priority: HIGHEST for action port [ 698.977587] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 289147c7-72c9-462d-b93d-0ae1bad6bcef with Priority: HIGHEST for action port [ 698.980826] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-289147c7-72c9-462d-b93d-0ae1bad6bcef taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.980826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-289147c7-72c9-462d-b93d-0ae1bad6bcef" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.980826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-289147c7-72c9-462d-b93d-0ae1bad6bcef" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.980826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-289147c7-72c9-462d-b93d-0ae1bad6bcef" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.980826] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('289147c7-72c9-462d-b93d-0ae1bad6bcef',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.054403] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.054629] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.054757] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.055038] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.055193] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.055352] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port d18371ed-6194-4c0c-ba38-eb6cee0489c1 not found, creating... [ 699.055603] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.056231] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.056231] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.056231] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.056444] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.056749] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.056904] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.057122] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.057335] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.057545] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.057625] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: d18371ed-6194-4c0c-ba38-eb6cee0489c1 is going to be created. [ 699.079479] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.079682] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.079802] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.080172] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.080869] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.080869] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-d18371ed-6194-4c0c-ba38-eb6cee0489c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.337392] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 699.337392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.337392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.337392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.337392] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.337392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.337392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.337392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.337392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.337942] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.337942] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.482284] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 289147c7-72c9-462d-b93d-0ae1bad6bcef [ 699.482504] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.482631] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.482695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.482902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.483762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.483913] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:289147c7-72c9-462d-b93d-0ae1bad6bcef already deleted. [ 699.484140] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-289147c7-72c9-462d-b93d-0ae1bad6bcef" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.823210] env[65136]: INFO networking_nsxv3.common.synchronization [req-63431dcb-9d6c-478d-9576-476f0178c4eb req-c7130006-e8b3-4f78-8d4b-4eb641671b68 service nova] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_rules [ 699.823395] env[65136]: INFO networking_nsxv3.common.synchronization [req-63431dcb-9d6c-478d-9576-476f0178c4eb req-c7130006-e8b3-4f78-8d4b-4eb641671b68 service nova] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 699.823528] env[65136]: INFO networking_nsxv3.common.synchronization [req-63431dcb-9d6c-478d-9576-476f0178c4eb req-c7130006-e8b3-4f78-8d4b-4eb641671b68 service nova] Enqueued Resource ID: d18371ed-6194-4c0c-ba38-eb6cee0489c1 with Priority: HIGHEST for action port [ 699.824420] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_rules [ 699.824420] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 699.824420] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d18371ed-6194-4c0c-ba38-eb6cee0489c1 with Priority: HIGHEST for action port [ 699.824576] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.824706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.824772] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.825194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.825194] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.825934] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.826094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.826136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.826564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.826722] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.826855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.826925] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.827240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.827295] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.827395] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.828178] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-d18371ed-6194-4c0c-ba38-eb6cee0489c1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.828301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d18371ed-6194-4c0c-ba38-eb6cee0489c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.828369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d18371ed-6194-4c0c-ba38-eb6cee0489c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.828520] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d18371ed-6194-4c0c-ba38-eb6cee0489c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.828594] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d18371ed-6194-4c0c-ba38-eb6cee0489c1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.840925] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.842994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.842994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.842994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.842994] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.842994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.842994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.842994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.842994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.842994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.842994] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.842994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.842994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.842994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.842994] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.842994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.842994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.842994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.842994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.843781] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.843781] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.329872] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.330987] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.331108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.333147] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d18371ed-6194-4c0c-ba38-eb6cee0489c1 with status ACTIVE [ 700.333147] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.333147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.333147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.333147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.333147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.333147] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.333147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.333147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.333147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.333147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.333147] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.333147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.333147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.333695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.333695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.333695] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d18371ed-6194-4c0c-ba38-eb6cee0489c1 is going to be updated. [ 700.346776] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7767bb26-265a-4c1f-9c68-9bd50a08bacb: rpc.has_security_group_logging(os_id): False [ 700.359371] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.359585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.359662] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.359864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.360603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.360880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d18371ed-6194-4c0c-ba38-eb6cee0489c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.367411] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.367411] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.367556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.367660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.367758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.368009] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.368142] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.368229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.368361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.368437] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.368614] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.368706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.368768] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.368905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.368977] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.369402] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.369647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.369728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.369894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.369973] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.370077] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be updated. [ 700.444795] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.446204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.446559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.447123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.447748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.470079] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 700.660874] env[65136]: INFO networking_nsxv3.common.synchronization [req-fc24ccd3-f935-4c0a-ac3a-fe86bb7eb248 req-9b44ac17-098e-46bf-a0f5-e3ab6682b6eb tempest-ServersTestJSON-750370346 tempest-ServersTestJSON-750370346-project-member] Enqueued Resource ID: 4450efc3-afd8-4465-8453-713d205d5684 with Priority: HIGHEST for action security_group_members [ 700.662496] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4450efc3-afd8-4465-8453-713d205d5684 with Priority: HIGHEST for action security_group_members [ 700.662496] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4450efc3-afd8-4465-8453-713d205d5684 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.662496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.662496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.663079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.663411] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.663411] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.663525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.663660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.663748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.663844] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4450efc3-afd8-4465-8453-713d205d5684',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.837501] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.166915] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.166915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.166915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.166915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.166915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.167198] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.167336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.167406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.167572] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.167656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.167784] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4450efc3-afd8-4465-8453-713d205d5684 already deleted. [ 701.167924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.340773] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.341255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.341355] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.341576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.341676] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.341785] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be created. [ 701.367944] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.368360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.368360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.368476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.368628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.382666] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: UNINITIALIZED for 2s [ 701.517424] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-228 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.517787] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-228" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.517787] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-228" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.518031] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-228" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.518322] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.518579] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.518579] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.518790] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.518926] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.519321] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.519439] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.519544] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.519646] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.519753] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.519851] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.519978] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.539612] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.539786] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 701.539922] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.540148] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-228" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.540496] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-bbc626b0-b44f-4884-b546-5d5cb3e169d2 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.541237] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-bbc626b0-b44f-4884-b546-5d5cb3e169d2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.541237] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-bbc626b0-b44f-4884-b546-5d5cb3e169d2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.541237] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-bbc626b0-b44f-4884-b546-5d5cb3e169d2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.541237] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbc626b0-b44f-4884-b546-5d5cb3e169d2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.652791] env[65136]: INFO networking_nsxv3.common.synchronization [None req-2a74dc73-8c82-44c4-beed-0e44065c6c86 tempest-ImagesOneServerNegativeTestJSON-685255343 tempest-ImagesOneServerNegativeTestJSON-685255343-project-member] Enqueued Resource ID: 9d178595-d6f5-48d9-94d7-81fcbdd59f10 with Priority: HIGHEST for action security_group_rules [ 701.652791] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d178595-d6f5-48d9-94d7-81fcbdd59f10 with Priority: HIGHEST for action security_group_rules [ 701.653068] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d178595-d6f5-48d9-94d7-81fcbdd59f10 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.653219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d178595-d6f5-48d9-94d7-81fcbdd59f10" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.653301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d178595-d6f5-48d9-94d7-81fcbdd59f10" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.653508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d178595-d6f5-48d9-94d7-81fcbdd59f10" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.653593] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d178595-d6f5-48d9-94d7-81fcbdd59f10',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.045094] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.045361] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.045588] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.045999] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.045999] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.046164] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port bbc626b0-b44f-4884-b546-5d5cb3e169d2 not found, creating... [ 702.046430] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.046585] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.046697] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.046912] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.047053] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.047326] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.047473] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.047583] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.047779] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.047904] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.048055] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: bbc626b0-b44f-4884-b546-5d5cb3e169d2 is going to be created. [ 702.069273] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.069273] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.069273] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.069273] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.069540] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.069767] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-bbc626b0-b44f-4884-b546-5d5cb3e169d2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.175734] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.175868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.175868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.176396] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.176522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.176655] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d178595-d6f5-48d9-94d7-81fcbdd59f10 already deleted. [ 702.176727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d178595-d6f5-48d9-94d7-81fcbdd59f10" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.483949] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 702.484291] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.484373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.484613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.484705] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.537442] env[65136]: INFO networking_nsxv3.common.synchronization [None req-86df3b8f-9569-45ba-84a3-6cb774520bef tempest-ImagesOneServerNegativeTestJSON-685255343 tempest-ImagesOneServerNegativeTestJSON-685255343-project-member] Enqueued Resource ID: 9d178595-d6f5-48d9-94d7-81fcbdd59f10 with Priority: HIGHEST for action security_group_rules [ 702.537963] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d178595-d6f5-48d9-94d7-81fcbdd59f10 with Priority: HIGHEST for action security_group_rules [ 702.538371] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d178595-d6f5-48d9-94d7-81fcbdd59f10 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.538459] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d178595-d6f5-48d9-94d7-81fcbdd59f10" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.538539] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d178595-d6f5-48d9-94d7-81fcbdd59f10" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.538757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d178595-d6f5-48d9-94d7-81fcbdd59f10" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.538812] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d178595-d6f5-48d9-94d7-81fcbdd59f10',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.846749] env[65136]: INFO networking_nsxv3.common.synchronization [req-fc24ccd3-f935-4c0a-ac3a-fe86bb7eb248 req-1eb1a222-01b6-4248-a913-024d1502d0e3 service nova] Enqueued Resource ID: 4450efc3-afd8-4465-8453-713d205d5684 with Priority: HIGHEST for action security_group_rules [ 702.846749] env[65136]: INFO networking_nsxv3.common.synchronization [req-fc24ccd3-f935-4c0a-ac3a-fe86bb7eb248 req-1eb1a222-01b6-4248-a913-024d1502d0e3 service nova] Enqueued Resource ID: 4450efc3-afd8-4465-8453-713d205d5684 with Priority: HIGHEST for action security_group_members [ 702.846749] env[65136]: INFO networking_nsxv3.common.synchronization [req-fc24ccd3-f935-4c0a-ac3a-fe86bb7eb248 req-1eb1a222-01b6-4248-a913-024d1502d0e3 service nova] Enqueued Resource ID: bbc626b0-b44f-4884-b546-5d5cb3e169d2 with Priority: HIGHEST for action port [ 702.846749] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4450efc3-afd8-4465-8453-713d205d5684 with Priority: HIGHEST for action security_group_rules [ 702.846749] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4450efc3-afd8-4465-8453-713d205d5684 with Priority: HIGHEST for action security_group_members [ 702.846749] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbc626b0-b44f-4884-b546-5d5cb3e169d2 with Priority: HIGHEST for action port [ 702.847624] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4450efc3-afd8-4465-8453-713d205d5684 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.847782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.847915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.848178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.848301] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4450efc3-afd8-4465-8453-713d205d5684',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.849806] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4450efc3-afd8-4465-8453-713d205d5684 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.849806] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.849806] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.849956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.850130] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.850868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.851559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.851731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.851828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.851930] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4450efc3-afd8-4465-8453-713d205d5684',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.852781] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbc626b0-b44f-4884-b546-5d5cb3e169d2 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.852910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbc626b0-b44f-4884-b546-5d5cb3e169d2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.852910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbc626b0-b44f-4884-b546-5d5cb3e169d2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.853190] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbc626b0-b44f-4884-b546-5d5cb3e169d2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.853190] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbc626b0-b44f-4884-b546-5d5cb3e169d2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.987150] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.987368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.987467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.987755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.987985] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.988206] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.988296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.988506] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.988631] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.988755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.988890] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.064256] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.064429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.064429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.064625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.064716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.064811] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d178595-d6f5-48d9-94d7-81fcbdd59f10 already deleted. [ 703.064896] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d178595-d6f5-48d9-94d7-81fcbdd59f10" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.168770] env[65136]: INFO networking_nsxv3.common.synchronization [req-d341ac4a-8eb8-4789-8231-1855230173e3 req-311d49df-3138-499b-8c2f-66d9c9e3a1b1 tempest-ServersNegativeTestJSON-605919058 tempest-ServersNegativeTestJSON-605919058-project-member] Enqueued Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_members [ 703.170453] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_members [ 703.170999] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.171223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.171336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.171900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.171900] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.172082] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.172148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.172351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.172446] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.172559] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.354573] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4450efc3-afd8-4465-8453-713d205d5684 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.354697] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.355318] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4450efc3-afd8-4465-8453-713d205d5684',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.355927] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bbc626b0-b44f-4884-b546-5d5cb3e169d2 with status ACTIVE [ 703.356199] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.356337] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.356404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.356662] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.356768] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.357498] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.357498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.357498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.357498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.357498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.357917] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.357917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.361600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.361745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.361745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.361970] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bbc626b0-b44f-4884-b546-5d5cb3e169d2 is going to be updated. [ 703.396972] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 703.397194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.397354] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.397577] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.397762] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.397870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.398482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.398482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.398482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.398482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.398482] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.408073] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.408309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.408384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.408588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.408725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.408894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbc626b0-b44f-4884-b546-5d5cb3e169d2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.494032] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.494032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.494032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.494032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.494032] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.494032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.494032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.494032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.494032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.494032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.494032] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.494032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.494032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.494032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.494032] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.494032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.494873] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.494873] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.494873] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.494873] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.494990] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.675711] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.675875] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.676014] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.679093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.679093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.679093] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.679093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.679093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.679093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.679093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.679093] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b already deleted. [ 703.679093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.864921] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4450efc3-afd8-4465-8453-713d205d5684',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.901733] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.901905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.901980] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.902220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.902396] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.902497] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.902563] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.902707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.902820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.902974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.903125] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.903242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.903307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.903488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.903644] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.903741] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.903807] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.903992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.904103] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.904576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.904576] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.997933] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7767bb26-265a-4c1f-9c68-9bd50a08bacb: rpc.has_security_group_logging(os_id): False [ 704.016073] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.016288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.016374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.016585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.016677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.016900] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.017074] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.017130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.017249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.017327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.017519] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.017623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.017699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.018592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.018592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.018592] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.018592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.018592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.018592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.018801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.018801] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be updated. [ 704.090076] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.090076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.090076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.090076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.090076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.105834] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 704.368485] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.368657] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.368692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.368915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.369019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.369130] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4450efc3-afd8-4465-8453-713d205d5684 is going to be created. [ 704.395219] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.395371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.395443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.395632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.395787] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.405019] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4450efc3-afd8-4465-8453-713d205d5684 in Status: UNINITIALIZED for 2s [ 704.406362] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605661ba-c8c2-4dae-8382-f55a5d1ead5d: rpc.has_security_group_logging(os_id): False [ 704.426195] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.426336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.426407] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.426615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.426706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.426909] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.427015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.427095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.427264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.427344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.427520] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.427628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.427677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.427817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.427891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.428152] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.428300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.428343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.428450] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.428524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.428628] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be created. [ 704.484365] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.484531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.484566] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.484789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.484962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.495670] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 704.552036] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-84 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.552575] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-84" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.552776] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-84" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.553225] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-84" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.553603] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.553831] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.554011] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.554349] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.554567] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.554865] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.555046] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.555225] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.555386] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.555556] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.555718] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.555925] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.584901] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.585094] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 704.585279] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.585463] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-84" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.585773] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-996df4ad-51a1-47c4-8d2b-6daa140949d7 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.585938] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.586063] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.586477] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.586665] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('996df4ad-51a1-47c4-8d2b-6daa140949d7',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.850988] env[65136]: INFO networking_nsxv3.common.synchronization [None req-9522a763-d9d4-48da-9d73-9897566d7e17 None None] Enqueued Resource ID: 44b243e0-d872-4953-be1b-fac6ec7f9a9c with Priority: HIGHEST for action port [ 704.851586] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44b243e0-d872-4953-be1b-fac6ec7f9a9c with Priority: HIGHEST for action port [ 704.851898] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-44b243e0-d872-4953-be1b-fac6ec7f9a9c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.852088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44b243e0-d872-4953-be1b-fac6ec7f9a9c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.852178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44b243e0-d872-4953-be1b-fac6ec7f9a9c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.852423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44b243e0-d872-4953-be1b-fac6ec7f9a9c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.852707] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44b243e0-d872-4953-be1b-fac6ec7f9a9c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.089211] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.089460] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.089750] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.090126] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.090318] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.090461] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 996df4ad-51a1-47c4-8d2b-6daa140949d7 not found, creating... [ 705.090841] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.090946] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.091090] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.091360] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.091444] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.091728] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.091873] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.091997] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.092194] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.092320] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.092457] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 996df4ad-51a1-47c4-8d2b-6daa140949d7 is going to be created. [ 705.113054] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.113321] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.113477] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.113790] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.114057] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.114285] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.355601] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44b243e0-d872-4953-be1b-fac6ec7f9a9c [ 705.356471] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.356471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.356471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.356471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.356668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.356668] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44b243e0-d872-4953-be1b-fac6ec7f9a9c already deleted. [ 705.356668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44b243e0-d872-4953-be1b-fac6ec7f9a9c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.808703] env[65136]: INFO networking_nsxv3.common.synchronization [req-d341ac4a-8eb8-4789-8231-1855230173e3 req-d52de4d4-990f-41f0-a4b1-15188129537d service nova] Enqueued Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_rules [ 705.809090] env[65136]: INFO networking_nsxv3.common.synchronization [req-d341ac4a-8eb8-4789-8231-1855230173e3 req-d52de4d4-990f-41f0-a4b1-15188129537d service nova] Enqueued Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_members [ 705.809227] env[65136]: INFO networking_nsxv3.common.synchronization [req-d341ac4a-8eb8-4789-8231-1855230173e3 req-d52de4d4-990f-41f0-a4b1-15188129537d service nova] Enqueued Resource ID: 996df4ad-51a1-47c4-8d2b-6daa140949d7 with Priority: HIGHEST for action port [ 705.809834] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_rules [ 705.809987] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_members [ 705.810719] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 996df4ad-51a1-47c4-8d2b-6daa140949d7 with Priority: HIGHEST for action port [ 705.811060] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.811361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.811361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.815119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.815119] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.815119] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.815119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.815119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.815119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.815119] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.815119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.815119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.815119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.815119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.815119] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.815119] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-996df4ad-51a1-47c4-8d2b-6daa140949d7 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.815119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.815119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.815119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.815119] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('996df4ad-51a1-47c4-8d2b-6daa140949d7',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.124989] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 706.125288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.321081] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.321081] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.321081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.321081] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 996df4ad-51a1-47c4-8d2b-6daa140949d7 with status ACTIVE [ 706.321081] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.322894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.322964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.325992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.326345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.326345] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.326462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.326489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.326757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.326757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.328019] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.328019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.328019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.328019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.328019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.328019] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 996df4ad-51a1-47c4-8d2b-6daa140949d7 is going to be updated. [ 706.351220] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.351220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.351220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.351220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.351220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.351220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.417043] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4450efc3-afd8-4465-8453-713d205d5684 in Status: SUCCESS [ 706.417137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.417342] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.417630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.417885] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.418064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.418170] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.418394] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.419023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.419560] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.419756] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4450efc3-afd8-4465-8453-713d205d5684',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.517140] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 706.518326] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.830386] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.922913] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4450efc3-afd8-4465-8453-713d205d5684',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.340973] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.340973] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.340973] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.340973] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.340973] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.340973] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b is going to be created. [ 707.367832] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.368318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.368519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.369042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.370739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.381787] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: UNINITIALIZED for 2s [ 707.424497] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4450efc3-afd8-4465-8453-713d205d5684: rpc.has_security_group_logging(os_id): False [ 707.436728] env[65136]: INFO networking_nsxv3.common.synchronization [None req-5f9154f3-aa00-4903-a8f5-4ea44c122345 None None] Enqueued Resource ID: 5f9c05b8-4747-4ee6-9aa7-0a789085e898 with Priority: HIGHEST for action port [ 707.439554] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f9c05b8-4747-4ee6-9aa7-0a789085e898 with Priority: HIGHEST for action port [ 707.439554] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f9c05b8-4747-4ee6-9aa7-0a789085e898 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.439554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f9c05b8-4747-4ee6-9aa7-0a789085e898" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.439554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f9c05b8-4747-4ee6-9aa7-0a789085e898" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.439554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f9c05b8-4747-4ee6-9aa7-0a789085e898" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.439554] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f9c05b8-4747-4ee6-9aa7-0a789085e898',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.442081] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.442211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.442302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.442537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.442825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.443112] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.443217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.443279] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.443438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.443514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.443600] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4450efc3-afd8-4465-8453-713d205d5684 is going to be created. [ 707.510995] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.511499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.512041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.512277] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.513985] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.523869] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4450efc3-afd8-4465-8453-713d205d5684 in Status: IN_PROGRESS for 2s [ 707.946673] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f9c05b8-4747-4ee6-9aa7-0a789085e898 [ 707.946932] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.946932] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.947035] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.947256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.947351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.948247] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f9c05b8-4747-4ee6-9aa7-0a789085e898 already deleted. [ 707.948366] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f9c05b8-4747-4ee6-9aa7-0a789085e898" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.272153] env[65136]: INFO networking_nsxv3.common.synchronization [None req-32879fe7-92e6-47e9-9cdd-d8043cd3e826 None None] Enqueued Resource ID: 8023bd36-1699-4a9d-9ed0-2f8ff0cf5349 with Priority: HIGHEST for action port [ 708.272153] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8023bd36-1699-4a9d-9ed0-2f8ff0cf5349 with Priority: HIGHEST for action port [ 708.272435] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-8023bd36-1699-4a9d-9ed0-2f8ff0cf5349 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.272583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8023bd36-1699-4a9d-9ed0-2f8ff0cf5349" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.272636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8023bd36-1699-4a9d-9ed0-2f8ff0cf5349" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.273029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8023bd36-1699-4a9d-9ed0-2f8ff0cf5349" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.273093] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8023bd36-1699-4a9d-9ed0-2f8ff0cf5349',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.502458] env[65136]: INFO networking_nsxv3.common.synchronization [req-306c64ce-cc02-470b-9b56-b80925e8948d req-ee1994d8-93e8-479a-81d4-0141e85768de tempest-FloatingIPsAssociationNegativeTestJSON-2039364408 tempest-FloatingIPsAssociationNegativeTestJSON-2039364408-project-member] Enqueued Resource ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 with Priority: HIGHEST for action security_group_members [ 708.503153] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 with Priority: HIGHEST for action security_group_members [ 708.503482] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.503578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.503656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.503952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.504053] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.504146] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.504350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.504350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.504475] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.504544] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.776009] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8023bd36-1699-4a9d-9ed0-2f8ff0cf5349 [ 708.776319] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.776440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.776496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.776695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.776784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.776878] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8023bd36-1699-4a9d-9ed0-2f8ff0cf5349 already deleted. [ 708.776961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8023bd36-1699-4a9d-9ed0-2f8ff0cf5349" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.008144] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.008144] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.008144] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.008144] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.008539] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.008539] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.008539] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.008637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.008949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.009047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.009172] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 already deleted. [ 709.009220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.040694] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.040949] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-974" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.041176] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-974" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.041993] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-974" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.041993] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.041993] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.042161] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.042278] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.042402] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.042605] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.042707] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.043527] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.043527] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.043527] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.043527] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.043527] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.061697] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.061851] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 709.061986] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.062180] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-974" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.062564] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-4ad5c88a-4172-42d5-b2a4-b0df792e93c8 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.062672] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-4ad5c88a-4172-42d5-b2a4-b0df792e93c8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.062757] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-4ad5c88a-4172-42d5-b2a4-b0df792e93c8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.063069] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-4ad5c88a-4172-42d5-b2a4-b0df792e93c8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.063238] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ad5c88a-4172-42d5-b2a4-b0df792e93c8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.392074] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: SUCCESS [ 709.392317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.392624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.392698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.392950] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.393087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.393151] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.393306] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.393389] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.393472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.393559] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.539870] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4450efc3-afd8-4465-8453-713d205d5684 in Status: SUCCESS [ 709.540314] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.568674] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.568899] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.568899] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.569378] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.569378] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.569491] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 4ad5c88a-4172-42d5-b2a4-b0df792e93c8 not found, creating... [ 709.569781] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.569935] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.570080] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.570294] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.571808] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.571808] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.571808] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.571808] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.571808] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.571808] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.571808] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 4ad5c88a-4172-42d5-b2a4-b0df792e93c8 is going to be created. [ 709.595950] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.595950] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.595950] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.595950] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.595950] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.595950] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-4ad5c88a-4172-42d5-b2a4-b0df792e93c8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.895881] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.897264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.897264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.897264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.897264] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.897264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.897264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.897264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.897264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.897264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.897644] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.897644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.897715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.897862] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.898062] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.898324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.898443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.898641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.898746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.898844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.898963] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.115159] env[65136]: INFO networking_nsxv3.common.synchronization [None req-9d32754c-6d06-4d81-9897-1d43678a286e None None] Enqueued Resource ID: cfcc4ad6-8f61-4764-9349-837544bc41cf with Priority: HIGHEST for action port [ 710.115159] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfcc4ad6-8f61-4764-9349-837544bc41cf with Priority: HIGHEST for action port [ 710.115684] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfcc4ad6-8f61-4764-9349-837544bc41cf taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.115979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfcc4ad6-8f61-4764-9349-837544bc41cf" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.116221] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfcc4ad6-8f61-4764-9349-837544bc41cf" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.116652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfcc4ad6-8f61-4764-9349-837544bc41cf" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.116825] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfcc4ad6-8f61-4764-9349-837544bc41cf',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.394607] env[65136]: INFO networking_nsxv3.common.synchronization [req-306c64ce-cc02-470b-9b56-b80925e8948d req-a75f53c6-e361-450c-a6a0-bcd581dad93a service nova] Enqueued Resource ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 with Priority: HIGHEST for action security_group_rules [ 710.394800] env[65136]: INFO networking_nsxv3.common.synchronization [req-306c64ce-cc02-470b-9b56-b80925e8948d req-a75f53c6-e361-450c-a6a0-bcd581dad93a service nova] Enqueued Resource ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 with Priority: HIGHEST for action security_group_members [ 710.394932] env[65136]: INFO networking_nsxv3.common.synchronization [req-306c64ce-cc02-470b-9b56-b80925e8948d req-a75f53c6-e361-450c-a6a0-bcd581dad93a service nova] Enqueued Resource ID: 4ad5c88a-4172-42d5-b2a4-b0df792e93c8 with Priority: HIGHEST for action port [ 710.395619] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 with Priority: HIGHEST for action security_group_rules [ 710.395768] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 with Priority: HIGHEST for action security_group_members [ 710.395861] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ad5c88a-4172-42d5-b2a4-b0df792e93c8 with Priority: HIGHEST for action port [ 710.396202] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.396317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.396402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.396839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.396916] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.397829] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.398031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.398123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.398309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.398794] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.399973] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.400060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.400227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.400319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.400446] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.402187] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ad5c88a-4172-42d5-b2a4-b0df792e93c8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.402300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ad5c88a-4172-42d5-b2a4-b0df792e93c8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.402388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ad5c88a-4172-42d5-b2a4-b0df792e93c8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.403377] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ad5c88a-4172-42d5-b2a4-b0df792e93c8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.403476] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ad5c88a-4172-42d5-b2a4-b0df792e93c8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.408785] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b: rpc.has_security_group_logging(os_id): False [ 710.428966] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.430155] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.430277] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.430588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.430656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.431543] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.431543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.431543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.431543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.431543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.431543] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.431833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.431833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.431833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.431926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.432183] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.432314] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.432399] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.432567] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.432661] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.432784] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b is going to be created. [ 710.498980] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.499143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.499556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.499556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.499664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.511814] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: IN_PROGRESS for 2s [ 710.621313] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfcc4ad6-8f61-4764-9349-837544bc41cf [ 710.622632] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.622632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.622632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.622632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.622632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.622632] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfcc4ad6-8f61-4764-9349-837544bc41cf already deleted. [ 710.622632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfcc4ad6-8f61-4764-9349-837544bc41cf" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.685366] env[65136]: INFO networking_nsxv3.common.synchronization [None req-6a08d4a4-214b-4ca1-9a2b-709a797e962a None None] Enqueued Resource ID: db825522-e05d-404f-9624-3ebb12662f33 with Priority: HIGHEST for action port [ 710.685649] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db825522-e05d-404f-9624-3ebb12662f33 with Priority: HIGHEST for action port [ 710.687570] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-db825522-e05d-404f-9624-3ebb12662f33 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.687702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db825522-e05d-404f-9624-3ebb12662f33" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.688069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db825522-e05d-404f-9624-3ebb12662f33" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.688526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db825522-e05d-404f-9624-3ebb12662f33" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.688615] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db825522-e05d-404f-9624-3ebb12662f33',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.903408] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.909850] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ad5c88a-4172-42d5-b2a4-b0df792e93c8 with status ACTIVE [ 710.909850] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.909850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.909850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.909850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.909850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.909850] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.909850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.909850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.910236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.910236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.910236] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.910346] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.910346] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.910838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.910838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.910838] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ad5c88a-4172-42d5-b2a4-b0df792e93c8 is going to be updated. [ 710.913100] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.913100] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.935396] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.935619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.935619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.935831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.936095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.936202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ad5c88a-4172-42d5-b2a4-b0df792e93c8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.056071] env[65136]: INFO networking_nsxv3.common.synchronization [req-868768c7-7267-42b4-b8e1-74f7c294d106 req-86eb05e8-7802-4c24-8f99-78b5834e9e30 tempest-ServersAdminTestJSON-92432023 tempest-ServersAdminTestJSON-92432023-project-member] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 711.056686] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 711.057000] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.057784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.057903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.058372] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.058635] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.058808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.058965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.059386] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.060602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.060820] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.190961] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db825522-e05d-404f-9624-3ebb12662f33 [ 711.191282] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.191412] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.191457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.191669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.191785] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.191860] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db825522-e05d-404f-9624-3ebb12662f33 already deleted. [ 711.191945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db825522-e05d-404f-9624-3ebb12662f33" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.407665] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.495380] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-718 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.495567] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.497058] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.497058] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.497058] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.497058] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.497058] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.497058] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.497058] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.497666] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.497666] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.497792] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.497923] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.498193] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.498281] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.498411] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.521149] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.521312] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 711.521442] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.523492] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.523890] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-93c9b90f-e06e-48b3-8ffc-bf05a81d12f0 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.524075] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-93c9b90f-e06e-48b3-8ffc-bf05a81d12f0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.524192] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-93c9b90f-e06e-48b3-8ffc-bf05a81d12f0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.524531] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-93c9b90f-e06e-48b3-8ffc-bf05a81d12f0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.526350] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93c9b90f-e06e-48b3-8ffc-bf05a81d12f0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.563927] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.910998] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.911934] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.911934] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.911934] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.911934] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.911934] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 is going to be created. [ 711.940850] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.941030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.941087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.941669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.941844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.953118] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 in Status: UNINITIALIZED for 2s [ 712.030174] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.030436] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.030561] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.030870] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.033267] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.033267] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 93c9b90f-e06e-48b3-8ffc-bf05a81d12f0 not found, creating... [ 712.033449] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.033565] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.033683] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.033954] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.034112] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.034422] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.034584] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.034700] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.034918] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.035065] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.035204] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 93c9b90f-e06e-48b3-8ffc-bf05a81d12f0 is going to be created. [ 712.059012] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.059359] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.059870] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.059870] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.059992] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.060255] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-93c9b90f-e06e-48b3-8ffc-bf05a81d12f0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.066236] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.532448] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: SUCCESS [ 712.532448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.559592] env[65136]: INFO networking_nsxv3.common.synchronization [None req-b3b01e20-1e47-4e5d-848b-43513b2c5304 None None] Enqueued Resource ID: a9d6e8a1-932b-4187-84a8-24763a1f3fe8 with Priority: HIGHEST for action port [ 712.560156] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9d6e8a1-932b-4187-84a8-24763a1f3fe8 with Priority: HIGHEST for action port [ 712.560467] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9d6e8a1-932b-4187-84a8-24763a1f3fe8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.560587] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9d6e8a1-932b-4187-84a8-24763a1f3fe8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.560655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9d6e8a1-932b-4187-84a8-24763a1f3fe8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.563271] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9d6e8a1-932b-4187-84a8-24763a1f3fe8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.563354] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9d6e8a1-932b-4187-84a8-24763a1f3fe8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.569639] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.569769] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.569932] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.570124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.570203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.570301] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be updated. [ 712.604224] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.604224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.604224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.604224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.604513] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.617768] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: IN_PROGRESS for 2s [ 713.066508] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9d6e8a1-932b-4187-84a8-24763a1f3fe8 [ 713.066836] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.066996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.067081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.067327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.067434] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.067532] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9d6e8a1-932b-4187-84a8-24763a1f3fe8 already deleted. [ 713.067617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9d6e8a1-932b-4187-84a8-24763a1f3fe8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.292371] env[65136]: INFO networking_nsxv3.common.synchronization [req-868768c7-7267-42b4-b8e1-74f7c294d106 req-99dc6121-b69e-41af-af51-768157790bdd service nova] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_rules [ 713.292956] env[65136]: INFO networking_nsxv3.common.synchronization [req-868768c7-7267-42b4-b8e1-74f7c294d106 req-99dc6121-b69e-41af-af51-768157790bdd service nova] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 713.292956] env[65136]: INFO networking_nsxv3.common.synchronization [req-868768c7-7267-42b4-b8e1-74f7c294d106 req-99dc6121-b69e-41af-af51-768157790bdd service nova] Enqueued Resource ID: 93c9b90f-e06e-48b3-8ffc-bf05a81d12f0 with Priority: HIGHEST for action port [ 713.293509] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_rules [ 713.296045] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 713.296216] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93c9b90f-e06e-48b3-8ffc-bf05a81d12f0 with Priority: HIGHEST for action port [ 713.296985] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.297165] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.297210] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.297498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.297557] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.299081] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.299081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.299081] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-93c9b90f-e06e-48b3-8ffc-bf05a81d12f0 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.300501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93c9b90f-e06e-48b3-8ffc-bf05a81d12f0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.300501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93c9b90f-e06e-48b3-8ffc-bf05a81d12f0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.300501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93c9b90f-e06e-48b3-8ffc-bf05a81d12f0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.300501] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93c9b90f-e06e-48b3-8ffc-bf05a81d12f0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.595322] env[65136]: INFO networking_nsxv3.common.synchronization [req-e78a2bf8-6100-4081-bed9-2c4d28cc4460 req-65000223-0923-439a-844e-db53f452b507 tempest-FloatingIPsAssociationTestJSON-852158796 tempest-FloatingIPsAssociationTestJSON-852158796-project-member] Enqueued Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_members [ 713.595793] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_members [ 713.596352] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.596352] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.596352] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.596550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.596728] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.596824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.596886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.597048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.597135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.597231] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.803810] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93c9b90f-e06e-48b3-8ffc-bf05a81d12f0 with status ACTIVE [ 713.803892] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.804026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.804117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.804340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.804429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.804612] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.804740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.804775] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.804893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.804975] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.805158] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.805296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.805296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.805455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.805500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.805584] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93c9b90f-e06e-48b3-8ffc-bf05a81d12f0 is going to be updated. [ 713.806779] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.806902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.832574] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.832760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.832907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.833176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.833319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.833540] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93c9b90f-e06e-48b3-8ffc-bf05a81d12f0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.963879] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 in Status: SUCCESS [ 713.964692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.964692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.964692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.964833] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.964923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.964985] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.965306] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.965471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.966341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.966341] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.995621] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.995621] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-516" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.995820] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-516" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.996050] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-516" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.996401] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.996574] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.996692] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.996902] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.997213] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.997472] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.997617] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.997752] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.997889] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.998032] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.998211] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.998454] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.017960] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.018226] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 714.018467] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.018672] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-516" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.019019] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-82e1b0d5-7fb1-48d3-a6cb-26d97df51082 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.019443] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-82e1b0d5-7fb1-48d3-a6cb-26d97df51082" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.019443] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-82e1b0d5-7fb1-48d3-a6cb-26d97df51082" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.019721] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-82e1b0d5-7fb1-48d3-a6cb-26d97df51082" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.019885] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82e1b0d5-7fb1-48d3-a6cb-26d97df51082',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.099590] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.099806] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.099902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.100221] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.100350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.100709] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.100846] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.100934] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.101161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.101268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.101384] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 already deleted. [ 714.101494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.467736] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.467906] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.467991] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.469669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.469883] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.470017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.470087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.470373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.470373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.470458] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.470625] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.470688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.470725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.470840] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.470982] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.471113] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.471167] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.471331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.471384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.471469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.471581] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.525684] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.525919] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.526154] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.526331] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.526474] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.526861] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 82e1b0d5-7fb1-48d3-a6cb-26d97df51082 not found, creating... [ 714.526861] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.527044] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.527168] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.527414] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.527753] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.528074] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.528293] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.528396] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.529252] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.529252] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.529252] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 82e1b0d5-7fb1-48d3-a6cb-26d97df51082 is going to be created. [ 714.548134] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.549588] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.549588] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.549588] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.549588] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.549588] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-82e1b0d5-7fb1-48d3-a6cb-26d97df51082" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.627108] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 714.627376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.627971] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.627971] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.627971] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.628169] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.628169] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.628311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.628381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.628485] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.974106] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5: rpc.has_security_group_logging(os_id): False [ 714.995880] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.995880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.996063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.997696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.997696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.997696] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.997696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.997696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.997696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.997696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.997696] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.997696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.997696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.997696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.997696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.997696] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.997696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.998425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.998425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.998425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.998425] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 is going to be created. [ 715.127545] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.127736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.127824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.128180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.128384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.131248] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.142402] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 in Status: IN_PROGRESS for 2s [ 715.360288] env[65136]: INFO networking_nsxv3.common.synchronization [req-e78a2bf8-6100-4081-bed9-2c4d28cc4460 req-e11165c9-22a6-488d-ad44-5115f342b6fc service nova] Enqueued Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_rules [ 715.360288] env[65136]: INFO networking_nsxv3.common.synchronization [req-e78a2bf8-6100-4081-bed9-2c4d28cc4460 req-e11165c9-22a6-488d-ad44-5115f342b6fc service nova] Enqueued Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_members [ 715.360475] env[65136]: INFO networking_nsxv3.common.synchronization [req-e78a2bf8-6100-4081-bed9-2c4d28cc4460 req-e11165c9-22a6-488d-ad44-5115f342b6fc service nova] Enqueued Resource ID: 82e1b0d5-7fb1-48d3-a6cb-26d97df51082 with Priority: HIGHEST for action port [ 715.361056] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_rules [ 715.361216] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_members [ 715.361320] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82e1b0d5-7fb1-48d3-a6cb-26d97df51082 with Priority: HIGHEST for action port [ 715.361596] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06b0bf22-61b9-4a96-a3f3-ec08a80369b4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.361732] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.361776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.362210] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.362210] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.363086] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.364144] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.364178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.364382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.364569] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.364656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.364735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.364995] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.364995] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.366697] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.368882] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-82e1b0d5-7fb1-48d3-a6cb-26d97df51082 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.368882] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82e1b0d5-7fb1-48d3-a6cb-26d97df51082" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.368882] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82e1b0d5-7fb1-48d3-a6cb-26d97df51082" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.369168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82e1b0d5-7fb1-48d3-a6cb-26d97df51082" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.369168] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82e1b0d5-7fb1-48d3-a6cb-26d97df51082',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.633812] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.871423] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.871526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.871733] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.872661] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82e1b0d5-7fb1-48d3-a6cb-26d97df51082 with status ACTIVE [ 715.874515] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.875621] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.875700] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.875918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.876049] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.876243] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.876350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.876419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.876666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.876666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.876839] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.876931] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.876993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.877728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.878852] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.878953] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82e1b0d5-7fb1-48d3-a6cb-26d97df51082 is going to be updated. [ 715.899931] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.900410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.901268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.901366] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.901513] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.901684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82e1b0d5-7fb1-48d3-a6cb-26d97df51082" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.942783] env[65136]: INFO networking_nsxv3.common.synchronization [req-bb332fb6-6526-4e33-a16e-5b96d4c2dc2e req-142fd8ee-680e-41d1-9376-8074e699eea3 tempest-DeleteServersTestJSON-1045367082 tempest-DeleteServersTestJSON-1045367082-project-member] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 715.943159] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 715.944962] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.945219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.945219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.945717] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.945717] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.945945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.946051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.946315] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.946393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.946505] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.136577] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.136767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.136836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.137089] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.137638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.137638] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be updated. [ 716.168765] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.168765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.168765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.169788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.169972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.181788] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: IN_PROGRESS for 2s [ 716.384058] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.452183] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.452468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.452468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.453780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.453780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.453780] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.453780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.453780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.453780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.454203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.454203] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 716.497059] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.497280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.497347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.498284] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.498284] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.514342] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 716.617503] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.617857] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.617857] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.618142] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.618423] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.618602] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.618740] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.619320] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.619518] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.619747] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.619907] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.619980] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.620103] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.620229] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.620340] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.620469] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.640359] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.640641] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 716.640691] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.640830] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.641190] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-5e8a5ace-1060-4828-bd0d-0a3f489e166b taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.641429] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-5e8a5ace-1060-4828-bd0d-0a3f489e166b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.641596] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-5e8a5ace-1060-4828-bd0d-0a3f489e166b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.641922] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-5e8a5ace-1060-4828-bd0d-0a3f489e166b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.642069] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e8a5ace-1060-4828-bd0d-0a3f489e166b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.886429] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.886583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.886655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.886863] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.886955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.887066] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 is going to be created. [ 716.911423] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.911593] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.911642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.911844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.912176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.924375] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 in Status: UNINITIALIZED for 2s [ 717.144882] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.145139] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.145283] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.145553] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.145698] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.145841] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 5e8a5ace-1060-4828-bd0d-0a3f489e166b not found, creating... [ 717.146349] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.146531] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.146680] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.146895] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.147045] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.147420] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.147601] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.147776] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.147973] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.148379] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.148496] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 5e8a5ace-1060-4828-bd0d-0a3f489e166b is going to be created. [ 717.169427] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 in Status: SUCCESS [ 717.169755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.178027] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.178345] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.178451] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.178764] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.179048] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.179323] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-5e8a5ace-1060-4828-bd0d-0a3f489e166b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.882836] env[65136]: INFO networking_nsxv3.common.synchronization [req-bb332fb6-6526-4e33-a16e-5b96d4c2dc2e req-f0664f6b-b010-4c12-b4f2-87bb4c6a28ac service nova] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_rules [ 717.883125] env[65136]: INFO networking_nsxv3.common.synchronization [req-bb332fb6-6526-4e33-a16e-5b96d4c2dc2e req-f0664f6b-b010-4c12-b4f2-87bb4c6a28ac service nova] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 717.883157] env[65136]: INFO networking_nsxv3.common.synchronization [req-bb332fb6-6526-4e33-a16e-5b96d4c2dc2e req-f0664f6b-b010-4c12-b4f2-87bb4c6a28ac service nova] Enqueued Resource ID: 5e8a5ace-1060-4828-bd0d-0a3f489e166b with Priority: HIGHEST for action port [ 717.883704] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_rules [ 717.883815] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 717.883915] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e8a5ace-1060-4828-bd0d-0a3f489e166b with Priority: HIGHEST for action port [ 717.884521] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.884698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.884807] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.885064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.885212] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.886209] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.886367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.886606] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e8a5ace-1060-4828-bd0d-0a3f489e166b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.886766] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e8a5ace-1060-4828-bd0d-0a3f489e166b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.887090] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e8a5ace-1060-4828-bd0d-0a3f489e166b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.887090] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e8a5ace-1060-4828-bd0d-0a3f489e166b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.887203] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e8a5ace-1060-4828-bd0d-0a3f489e166b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.191589] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 718.192107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.192107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.192330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.192536] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.192686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.192913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.192975] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.193123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.193123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.193234] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.389592] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.392406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.392636] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e8a5ace-1060-4828-bd0d-0a3f489e166b with status ACTIVE [ 718.392861] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.395624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.395624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.395624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.395624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.395624] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.395624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.395624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.395624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.395624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.395624] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.396027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.396027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.396027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.396027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.396027] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e8a5ace-1060-4828-bd0d-0a3f489e166b is going to be updated. [ 718.420246] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.420246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.420246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.420246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.420246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.420246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e8a5ace-1060-4828-bd0d-0a3f489e166b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.525844] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 718.526437] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 deletion is rescheduled due to dependency. [ 718.526437] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.526437] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.526597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.526688] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.526907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.526907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.527068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.527097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.527200] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.695729] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.695892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.695963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.696199] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.696364] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.696455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.696527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.696666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.696754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.696838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.696979] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.697088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.697149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.697291] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.697429] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.700224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.700272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.700430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.700522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.700612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.700707] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.935147] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 in Status: SUCCESS [ 718.935430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.935608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.935855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.936339] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.936403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.936436] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.936626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.936738] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.936832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.936938] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.029634] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.203665] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 171f535d-ebee-432f-b393-d063259af9b9: rpc.has_security_group_logging(os_id): False [ 719.224201] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.224396] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.224518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.224813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.224938] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.225229] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.225367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.225412] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.225610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.225696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.225946] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.226076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.226140] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.226308] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.226382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.226570] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.226664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.226731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.226907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.226981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.227081] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be updated. [ 719.323159] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.323359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.323359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.323626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.324316] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.342166] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: IN_PROGRESS for 2s [ 719.440895] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.440895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.440895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.440895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.440895] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.440895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.440895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.440895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.440895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.441759] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.441878] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.441976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.442051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.442206] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.442369] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.442462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.442523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.442879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.443013] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.443143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.443241] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.532400] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.946268] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06b0bf22-61b9-4a96-a3f3-ec08a80369b4: rpc.has_security_group_logging(os_id): False [ 719.966734] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.966969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.966969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.967182] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.967300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.967574] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.967996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.967996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.967996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.967996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.968193] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.968625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.968625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.968625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.968625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.968776] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.970499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.970499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.970499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.970499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.970499] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 is going to be created. [ 720.036617] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.036769] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.036809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.037034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.037211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.038459] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.038577] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.038641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.038784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.038860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.038966] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 720.052132] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 in Status: IN_PROGRESS for 2s [ 720.074890] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.074890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.074890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.074890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.074890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.088711] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 720.753949] env[65136]: INFO networking_nsxv3.common.synchronization [req-cd2154e9-6696-4c64-910e-e9feafa22148 req-690672a2-e546-409d-b09d-eda76edbe5ac tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 720.754527] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 720.754857] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.754978] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.755078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.755336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.755516] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.755623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.755684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.755974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.755974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.756115] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.066236] env[65136]: INFO networking_nsxv3.common.synchronization [req-435470a7-996a-4688-9261-7a5ddb68cce7 req-920187c6-ffa4-437a-92cd-5c0046d392f0 tempest-ImagesOneServerNegativeTestJSON-685255343 tempest-ImagesOneServerNegativeTestJSON-685255343-project-member] Enqueued Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 721.066632] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 721.066887] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.067781] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.067987] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.068294] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.068464] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.068569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.068629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.068781] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.068891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.068986] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.126164] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-998 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.126164] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.126164] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.126439] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.126733] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.126901] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.127028] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.127720] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.127720] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.127720] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.127884] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.127935] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.128098] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.128254] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.128404] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.128667] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.157590] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.157961] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.158223] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.158671] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.159097] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-296fe211-5d95-4e6d-a9e4-f4ffefc73ab8 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.159371] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-296fe211-5d95-4e6d-a9e4-f4ffefc73ab8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.159943] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-296fe211-5d95-4e6d-a9e4-f4ffefc73ab8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.160166] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-296fe211-5d95-4e6d-a9e4-f4ffefc73ab8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.160393] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('296fe211-5d95-4e6d-a9e4-f4ffefc73ab8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.257814] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.258474] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.258474] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.258594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.258672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.258943] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.259099] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.259195] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.259439] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.259672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.259672] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde already deleted. [ 721.259778] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.357629] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 721.357874] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.543550] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.543550] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-913" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.543550] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-913" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.543756] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-913" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.544021] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.544120] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.544437] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.544437] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.544565] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.544764] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.545050] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.546241] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.546241] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.546241] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.546241] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.546241] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.568279] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.568500] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.568595] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.568767] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-913" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.569100] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-a774aacb-05ba-47df-b6b3-d942022e2833 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.569318] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-a774aacb-05ba-47df-b6b3-d942022e2833" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.569449] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-a774aacb-05ba-47df-b6b3-d942022e2833" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.569856] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-a774aacb-05ba-47df-b6b3-d942022e2833" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.569989] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a774aacb-05ba-47df-b6b3-d942022e2833',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.572739] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.572866] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.572938] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.573135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.573231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.573416] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.573514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.573582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.573734] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.573810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.573896] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b is going to be updated. [ 721.603467] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.603607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.603705] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.603880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.604033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.615499] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: IN_PROGRESS for 2s [ 721.663737] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.663924] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.664033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.664322] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.664483] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.664635] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 296fe211-5d95-4e6d-a9e4-f4ffefc73ab8 not found, creating... [ 721.664884] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.665055] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.665213] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.665433] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.665792] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.666128] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.666455] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.666589] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.666796] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.666931] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.667082] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 296fe211-5d95-4e6d-a9e4-f4ffefc73ab8 is going to be created. [ 721.693536] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.693902] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.694142] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.694481] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.694789] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.695110] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-296fe211-5d95-4e6d-a9e4-f4ffefc73ab8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.067436] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 in Status: SUCCESS [ 722.067834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.072735] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.073071] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.073264] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.073670] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.073916] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.074153] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port a774aacb-05ba-47df-b6b3-d942022e2833 not found, creating... [ 722.074570] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.074804] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.074965] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.075306] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.075634] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.075991] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.076272] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.076486] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.076804] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.077026] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.077248] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: a774aacb-05ba-47df-b6b3-d942022e2833 is going to be created. [ 722.101348] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 722.101643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.102068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.102068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.102316] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.102496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.102554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.102792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.102909] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.103055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.103168] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.109940] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.110176] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.110238] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.110546] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.110817] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.111156] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-a774aacb-05ba-47df-b6b3-d942022e2833" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.521264] env[65136]: INFO networking_nsxv3.common.synchronization [req-cd2154e9-6696-4c64-910e-e9feafa22148 req-491d7691-cd31-4ca1-b136-aebea4a1e173 service nova] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_rules [ 722.521264] env[65136]: INFO networking_nsxv3.common.synchronization [req-cd2154e9-6696-4c64-910e-e9feafa22148 req-491d7691-cd31-4ca1-b136-aebea4a1e173 service nova] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 722.521264] env[65136]: INFO networking_nsxv3.common.synchronization [req-cd2154e9-6696-4c64-910e-e9feafa22148 req-491d7691-cd31-4ca1-b136-aebea4a1e173 service nova] Enqueued Resource ID: 296fe211-5d95-4e6d-a9e4-f4ffefc73ab8 with Priority: HIGHEST for action port [ 722.521912] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_rules [ 722.523622] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 722.523622] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 296fe211-5d95-4e6d-a9e4-f4ffefc73ab8 with Priority: HIGHEST for action port [ 722.523622] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.523622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.523622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.524374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.524585] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.525871] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.526195] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.526405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.527066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.527066] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.527566] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.530285] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.530285] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.530285] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.530285] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.530285] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-296fe211-5d95-4e6d-a9e4-f4ffefc73ab8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.530285] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-296fe211-5d95-4e6d-a9e4-f4ffefc73ab8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.530285] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-296fe211-5d95-4e6d-a9e4-f4ffefc73ab8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.530285] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-296fe211-5d95-4e6d-a9e4-f4ffefc73ab8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.530285] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('296fe211-5d95-4e6d-a9e4-f4ffefc73ab8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.605563] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.605742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.605783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.606064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.606219] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.606307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.606366] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.606651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.606651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.606651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.606796] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.606901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.606940] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.607096] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.607247] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.607327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.607554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.607614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.607721] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.607770] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.607877] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.830690] env[65136]: INFO networking_nsxv3.common.synchronization [req-435470a7-996a-4688-9261-7a5ddb68cce7 req-fed0d23c-7d32-4ae4-a579-8d95f2233e5a service nova] Enqueued Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_rules [ 722.830908] env[65136]: INFO networking_nsxv3.common.synchronization [req-435470a7-996a-4688-9261-7a5ddb68cce7 req-fed0d23c-7d32-4ae4-a579-8d95f2233e5a service nova] Enqueued Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 722.831061] env[65136]: INFO networking_nsxv3.common.synchronization [req-435470a7-996a-4688-9261-7a5ddb68cce7 req-fed0d23c-7d32-4ae4-a579-8d95f2233e5a service nova] Enqueued Resource ID: a774aacb-05ba-47df-b6b3-d942022e2833 with Priority: HIGHEST for action port [ 722.831631] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_rules [ 722.831779] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 722.831898] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a774aacb-05ba-47df-b6b3-d942022e2833 with Priority: HIGHEST for action port [ 722.832538] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.832668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.832737] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.832938] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.833038] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.834028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.834437] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.835135] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-a774aacb-05ba-47df-b6b3-d942022e2833 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.835135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a774aacb-05ba-47df-b6b3-d942022e2833" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.835135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a774aacb-05ba-47df-b6b3-d942022e2833" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.835135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a774aacb-05ba-47df-b6b3-d942022e2833" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.835135] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a774aacb-05ba-47df-b6b3-d942022e2833',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.035207] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.035207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.035207] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.035207] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 296fe211-5d95-4e6d-a9e4-f4ffefc73ab8 with status ACTIVE [ 723.035207] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.035207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.036870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.037426] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.037770] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.040460] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.040460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.040460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.040460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.040460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.040460] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.040460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.040460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.040460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.040460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.042324] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 296fe211-5d95-4e6d-a9e4-f4ffefc73ab8 is going to be updated. [ 723.065538] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.065705] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.065705] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.065946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.066184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.066908] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-296fe211-5d95-4e6d-a9e4-f4ffefc73ab8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.110083] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5ef8f7d-8350-4fe2-9bef-70ff70b5f141: rpc.has_security_group_logging(os_id): False [ 723.131065] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.131286] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.131368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.131629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.131782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.132015] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.132221] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.132281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.132491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.132580] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.132803] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.132925] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.132992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.133479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.133736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.134091] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.134187] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.134318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.134575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.134713] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.134911] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 723.139858] env[65136]: INFO networking_nsxv3.common.synchronization [req-dd602bf2-e30b-4ab1-8106-ba60c55dc5e5 req-0216cfe3-8a39-47cc-8000-3ef5670130bd tempest-ServersTestMultiNic-1831982173 tempest-ServersTestMultiNic-1831982173-project-member] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 723.140743] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 723.141165] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.141336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.141428] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.141656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.141846] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.141968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.142123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.142375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.142535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.142656] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.252871] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.252871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.252871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.253149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.253149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.273776] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 723.337992] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a774aacb-05ba-47df-b6b3-d942022e2833 with status ACTIVE [ 723.338484] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.338672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.338747] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.339029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.339227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.339994] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.340191] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.340269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.340551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.340707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.341014] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.341199] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.341199] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.341396] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.341479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.341563] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a774aacb-05ba-47df-b6b3-d942022e2833 is going to be updated. [ 723.342983] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.343196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.369251] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.369520] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.369651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.369964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.370311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.370577] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a774aacb-05ba-47df-b6b3-d942022e2833" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.532615] env[65136]: INFO networking_nsxv3.common.synchronization [req-dd602bf2-e30b-4ab1-8106-ba60c55dc5e5 req-2823408c-b64d-4f71-ae70-504dd0686c02 tempest-ServersTestMultiNic-1831982173 tempest-ServersTestMultiNic-1831982173-project-member] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 723.533268] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 723.533591] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.533696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.544996] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.624592] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: SUCCESS [ 723.624872] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b deletion is rescheduled due to dependency. [ 723.624963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.625092] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.625380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.625587] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.625762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.625829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.625984] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.626109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.626209] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.645573] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.664667] env[65136]: INFO networking_nsxv3.common.synchronization [req-9184a8b5-31bd-49eb-9e1c-ec351ea2ed2b req-4a678502-c502-479a-889f-d03748864763 tempest-ListServersNegativeTestJSON-1898468254 tempest-ListServersNegativeTestJSON-1898468254-project-member] Enqueued Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 723.665168] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 723.665461] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.665584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.665652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.665906] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.666165] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.666295] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.666336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.666520] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.666583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.666632] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.768607] env[65136]: INFO networking_nsxv3.common.synchronization [req-dd602bf2-e30b-4ab1-8106-ba60c55dc5e5 req-f5cb08aa-a54b-46cd-b04f-8967ca35af10 tempest-ServersTestMultiNic-1831982173 tempest-ServersTestMultiNic-1831982173-project-member] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 723.768896] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 723.769329] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.769476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.048376] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.048837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.048931] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.049315] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.049474] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.049633] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be created. [ 724.076311] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.076497] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.076574] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.076809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.076976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.087341] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: UNINITIALIZED for 2s [ 724.095562] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.095773] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-470" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.096071] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-470" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.096241] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-470" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.096514] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.096669] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.096778] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.096987] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.097139] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.097346] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.097446] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 724.097620] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 724.097688] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 724.097759] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 724.097852] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 724.097970] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 724.116799] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 724.117090] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 724.117090] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 724.117262] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-470" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.117574] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-b14cb3c4-cb92-4d25-8ae6-7c981b008286 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.117746] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-b14cb3c4-cb92-4d25-8ae6-7c981b008286" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.117900] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-b14cb3c4-cb92-4d25-8ae6-7c981b008286" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.118284] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-b14cb3c4-cb92-4d25-8ae6-7c981b008286" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.118428] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b14cb3c4-cb92-4d25-8ae6-7c981b008286',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.128531] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.147661] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.168957] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.169202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.169304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.169546] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.169667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.169891] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.170051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.170140] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.170303] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.170428] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.170534] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287b8551-3bf8-4455-afb3-b406697983a1 already deleted. [ 724.170663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.623223] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.623465] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.623604] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.623891] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.624067] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.624232] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port b14cb3c4-cb92-4d25-8ae6-7c981b008286 not found, creating... [ 724.624521] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.624700] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.624839] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.625105] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.625267] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.625562] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.625719] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.625843] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.626070] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.626242] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.626379] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: b14cb3c4-cb92-4d25-8ae6-7c981b008286 is going to be created. [ 724.631176] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.649321] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.649548] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.649771] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.649912] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.650145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.650364] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-b14cb3c4-cb92-4d25-8ae6-7c981b008286" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.651343] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.651455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.651523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.651731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.652060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.652060] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be updated. [ 724.697445] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.697680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.697680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.698248] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.698400] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.728358] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 725.133986] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.133986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.133986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.133986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.133986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.134685] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b is going to be updated. [ 725.172114] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.172281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.172372] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.173279] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.173494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.188393] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: IN_PROGRESS for 2s [ 725.295289] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 725.295289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.449919] env[65136]: INFO networking_nsxv3.common.synchronization [req-9184a8b5-31bd-49eb-9e1c-ec351ea2ed2b req-c8441858-3b87-4f03-9793-79676925449e service nova] Enqueued Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_rules [ 725.450222] env[65136]: INFO networking_nsxv3.common.synchronization [req-9184a8b5-31bd-49eb-9e1c-ec351ea2ed2b req-c8441858-3b87-4f03-9793-79676925449e service nova] Enqueued Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 725.450426] env[65136]: INFO networking_nsxv3.common.synchronization [req-9184a8b5-31bd-49eb-9e1c-ec351ea2ed2b req-c8441858-3b87-4f03-9793-79676925449e service nova] Enqueued Resource ID: b14cb3c4-cb92-4d25-8ae6-7c981b008286 with Priority: HIGHEST for action port [ 725.450994] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_rules [ 725.451162] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 725.451235] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b14cb3c4-cb92-4d25-8ae6-7c981b008286 with Priority: HIGHEST for action port [ 725.451893] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.451893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.451893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.452120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.452221] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.454422] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.454566] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.454652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.454856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.455056] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.455161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.455223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.455391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.455856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.455856] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.458728] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-b14cb3c4-cb92-4d25-8ae6-7c981b008286 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.458878] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b14cb3c4-cb92-4d25-8ae6-7c981b008286" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.458947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b14cb3c4-cb92-4d25-8ae6-7c981b008286" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.459182] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b14cb3c4-cb92-4d25-8ae6-7c981b008286" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.459280] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b14cb3c4-cb92-4d25-8ae6-7c981b008286',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.961818] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.964370] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.964650] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.964650] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b14cb3c4-cb92-4d25-8ae6-7c981b008286 with status ACTIVE [ 725.964868] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.964993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.965086] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.965271] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.965372] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.965526] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.965626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.965688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.966343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.966343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.966343] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.966343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.966343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.966652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.966652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.966652] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b14cb3c4-cb92-4d25-8ae6-7c981b008286 is going to be updated. [ 725.991040] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.991040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.991280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.991280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.991424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.991588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b14cb3c4-cb92-4d25-8ae6-7c981b008286" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.106374] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 726.106609] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.106834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.107111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.107337] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.107472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.107535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.107715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.107796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.107915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.108041] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.237856] env[65136]: INFO networking_nsxv3.common.synchronization [req-9184a8b5-31bd-49eb-9e1c-ec351ea2ed2b req-4f0a9903-3963-493f-b3aa-ad714af2a400 tempest-ListServersNegativeTestJSON-1898468254 tempest-ListServersNegativeTestJSON-1898468254-project-member] Enqueued Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 726.237856] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 726.238323] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.238323] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.468541] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.611193] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.611443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.611481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.611725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.611939] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.612180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.612180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.612965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.612965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.612965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.612965] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.612965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.612965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.613241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.613241] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.613241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.613336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.613460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.613517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.613785] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.613785] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.705439] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.705786] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-470" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.706987] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-470" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.706987] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-470" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.707145] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.707323] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.707650] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.707773] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.707973] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.708462] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.708462] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.709826] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.709826] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.709826] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 726.709826] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.709826] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.731266] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.732199] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 726.732199] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.732199] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-470" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.732434] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-602759f1-77d9-4e4c-a650-9939bbb3c027 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.732709] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-602759f1-77d9-4e4c-a650-9939bbb3c027" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.732962] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-602759f1-77d9-4e4c-a650-9939bbb3c027" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.733296] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-602759f1-77d9-4e4c-a650-9939bbb3c027" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.733533] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('602759f1-77d9-4e4c-a650-9939bbb3c027',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.744104] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 726.744529] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.745108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.745331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.745565] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.745687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.745805] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.745908] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.745993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.746190] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.972343] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.973563] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.973563] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.973563] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.973563] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.973563] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287b8551-3bf8-4455-afb3-b406697983a1 is going to be created. [ 727.019651] env[65136]: INFO networking_nsxv3.common.synchronization [req-0f4d6ab5-3d86-4433-9fbc-b2c5dfdac8a7 req-e7183040-8c80-43f8-8a30-4a7e24d520c0 tempest-ImagesOneServerTestJSON-1456813045 tempest-ImagesOneServerTestJSON-1456813045-project-member] Enqueued Resource ID: c9e25239-cb71-43b7-9bce-b16b700986d4 with Priority: HIGHEST for action security_group_members [ 727.020383] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9e25239-cb71-43b7-9bce-b16b700986d4 with Priority: HIGHEST for action security_group_members [ 727.020718] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-c9e25239-cb71-43b7-9bce-b16b700986d4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.020913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.020913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.021142] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.021306] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.021438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.021481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.021622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.021760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.021819] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c9e25239-cb71-43b7-9bce-b16b700986d4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.024849] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.025371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.025371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.025371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.025851] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.042371] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: UNINITIALIZED for 2s [ 727.118104] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ffd4802-244f-43db-9a7c-a5a1b6672fde: rpc.has_security_group_logging(os_id): False [ 727.139758] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.139758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.139758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.140334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.140334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.140334] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.140561] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.140561] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.141063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.141063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.141063] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.141194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.141233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.141405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.141529] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.141705] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.141789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.142103] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.142103] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.144635] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.144635] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be created. [ 727.202295] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: SUCCESS [ 727.202763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.203067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.203369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.204362] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.204362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.204362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.204362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.204362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.204362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.204362] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.213068] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.213273] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.213314] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.213505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.213688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.230361] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: IN_PROGRESS for 2s [ 727.236620] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.236864] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.236989] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.237272] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.237426] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.237666] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 602759f1-77d9-4e4c-a650-9939bbb3c027 not found, creating... [ 727.237885] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.238141] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.238239] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.238436] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.238757] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.239105] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.239269] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.239444] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.239734] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.239889] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.240112] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 602759f1-77d9-4e4c-a650-9939bbb3c027 is going to be created. [ 727.248408] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.248630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.248690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.248912] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.249017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.249240] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.249341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.249395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.249589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.249639] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.249701] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be updated. [ 727.283287] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.283658] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.283658] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.283894] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.284155] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.284483] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-602759f1-77d9-4e4c-a650-9939bbb3c027" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.300042] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.300223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.300278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.300471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.300725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.315053] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 727.524170] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.524331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.524398] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.524612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.524706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.524974] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.525226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.525299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.525561] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.525561] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.525707] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9e25239-cb71-43b7-9bce-b16b700986d4 is going to be updated. [ 727.559016] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.559524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.559639] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.559855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.559994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.576030] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9e25239-cb71-43b7-9bce-b16b700986d4 in Status: IN_PROGRESS for 2s [ 727.706392] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.706592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.706646] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.706828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.706985] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.707092] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.707151] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.707293] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.707443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.707483] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.707626] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.707714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.707774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.707881] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.708014] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.708105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.708225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.708340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.708429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.708488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.708581] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.030352] env[65136]: INFO networking_nsxv3.common.synchronization [req-9184a8b5-31bd-49eb-9e1c-ec351ea2ed2b req-29d291c5-0f1a-4093-88dc-19fc2485641c service nova] Enqueued Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_rules [ 728.030601] env[65136]: INFO networking_nsxv3.common.synchronization [req-9184a8b5-31bd-49eb-9e1c-ec351ea2ed2b req-29d291c5-0f1a-4093-88dc-19fc2485641c service nova] Enqueued Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 728.030800] env[65136]: INFO networking_nsxv3.common.synchronization [req-9184a8b5-31bd-49eb-9e1c-ec351ea2ed2b req-29d291c5-0f1a-4093-88dc-19fc2485641c service nova] Enqueued Resource ID: 602759f1-77d9-4e4c-a650-9939bbb3c027 with Priority: HIGHEST for action port [ 728.031594] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_rules [ 728.031839] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 728.031944] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 602759f1-77d9-4e4c-a650-9939bbb3c027 with Priority: HIGHEST for action port [ 728.032372] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.032558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.032802] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.032927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.033203] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-602759f1-77d9-4e4c-a650-9939bbb3c027 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.033349] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-602759f1-77d9-4e4c-a650-9939bbb3c027" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.033730] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-602759f1-77d9-4e4c-a650-9939bbb3c027" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.033730] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-602759f1-77d9-4e4c-a650-9939bbb3c027" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.033866] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('602759f1-77d9-4e4c-a650-9939bbb3c027',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.212498] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee57c421-9f97-4726-90f3-a34f9975cc5b: rpc.has_security_group_logging(os_id): False [ 728.231869] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.231869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.231869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.231869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.231869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.231869] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.231869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.231869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.232325] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.232325] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.232325] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.232325] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.232447] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.232642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.232642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.232781] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.232877] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.232935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.233230] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.233367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.233479] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b is going to be updated. [ 728.321744] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.321744] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.324402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.324402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.324402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.341304] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: IN_PROGRESS for 2s [ 728.537189] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 602759f1-77d9-4e4c-a650-9939bbb3c027 with status ACTIVE [ 728.537457] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.537551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.537551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.537809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.537889] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.538095] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.538221] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.538301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.538442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.538521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.538708] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.538799] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.538877] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.538988] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.539073] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.539163] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 602759f1-77d9-4e4c-a650-9939bbb3c027 is going to be updated. [ 728.565974] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.566278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.566370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.566623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.566910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.567197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-602759f1-77d9-4e4c-a650-9939bbb3c027" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.054739] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: SUCCESS [ 729.055114] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.055355] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.055582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.055799] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.055922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.055980] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.056168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.056242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.057438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.057438] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.059332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.059597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.059887] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.060033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.060136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.060387] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.060490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.060585] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.248887] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 729.248887] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.329123] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 729.329123] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb deletion is rescheduled due to dependency. [ 729.329123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.329123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.329123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.331825] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.331825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.331825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.331825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.331825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.331825] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.563798] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.564117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.564194] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.589354] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c9e25239-cb71-43b7-9bce-b16b700986d4 in Status: SUCCESS [ 729.589538] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c9e25239-cb71-43b7-9bce-b16b700986d4 deletion is rescheduled due to dependency. [ 729.589730] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.688878] env[65136]: INFO networking_nsxv3.common.synchronization [req-9184a8b5-31bd-49eb-9e1c-ec351ea2ed2b req-92a02a89-556a-46db-968e-e922f1e9c014 tempest-ListServersNegativeTestJSON-1898468254 tempest-ListServersNegativeTestJSON-1898468254-project-member] Enqueued Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 729.689490] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 729.689794] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.689891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.811033] env[65136]: INFO networking_nsxv3.common.synchronization [None req-f1cf3fd1-1a73-46c6-8d49-04d06778d99a None None] Enqueued Resource ID: 745747f7-9ee7-447c-99a4-c1dbd6f63137 with Priority: HIGHEST for action port [ 729.811033] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745747f7-9ee7-447c-99a4-c1dbd6f63137 with Priority: HIGHEST for action port [ 729.811273] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-745747f7-9ee7-447c-99a4-c1dbd6f63137 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.811527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-745747f7-9ee7-447c-99a4-c1dbd6f63137" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.811679] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-745747f7-9ee7-447c-99a4-c1dbd6f63137" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.812037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-745747f7-9ee7-447c-99a4-c1dbd6f63137" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.812245] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('745747f7-9ee7-447c-99a4-c1dbd6f63137',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.837203] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.837203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.837203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.837203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.837203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.837203] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.837203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.837203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.837203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.837203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.837203] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be updated. [ 729.876254] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.876254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.876254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.876254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.876254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.890439] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 730.067502] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.120019] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-470 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.120019] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-470" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.122897] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-470" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.122897] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-470" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.122897] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.122897] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.122897] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.122897] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.122897] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.122897] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.122897] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 730.122897] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 730.122897] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 730.122897] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 730.122897] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 730.122897] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 730.153091] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 730.153091] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 730.153091] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 730.153091] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-470" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.153091] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-a185c15b-fd8e-423e-8117-c00075004d55 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.153396] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-a185c15b-fd8e-423e-8117-c00075004d55" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.153396] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-a185c15b-fd8e-423e-8117-c00075004d55" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.155832] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-a185c15b-fd8e-423e-8117-c00075004d55" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.155832] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a185c15b-fd8e-423e-8117-c00075004d55',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.314953] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 745747f7-9ee7-447c-99a4-c1dbd6f63137 [ 730.315261] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.315385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.315443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.315618] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.315712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.315807] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:745747f7-9ee7-447c-99a4-c1dbd6f63137 already deleted. [ 730.315886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-745747f7-9ee7-447c-99a4-c1dbd6f63137" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.358370] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: SUCCESS [ 730.358370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.570905] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.570905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.571097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.571806] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.571806] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.571806] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287b8551-3bf8-4455-afb3-b406697983a1 is going to be updated. [ 730.604088] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.604163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.604241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.604447] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.604652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.616933] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: IN_PROGRESS for 2s [ 730.658703] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.658871] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.658999] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.659360] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.659545] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.660104] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port a185c15b-fd8e-423e-8117-c00075004d55 not found, creating... [ 730.660104] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.660249] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.660404] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.660819] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.660870] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.661323] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.661543] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.661601] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.661847] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.661985] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.662234] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: a185c15b-fd8e-423e-8117-c00075004d55 is going to be created. [ 730.687393] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.688580] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.688580] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.688580] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.688580] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.688580] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-a185c15b-fd8e-423e-8117-c00075004d55" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.546651] env[65136]: INFO networking_nsxv3.common.synchronization [req-9184a8b5-31bd-49eb-9e1c-ec351ea2ed2b req-b90dbe19-090f-4010-bd9d-16b3dc5eb0c1 service nova] Enqueued Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_rules [ 731.546919] env[65136]: INFO networking_nsxv3.common.synchronization [req-9184a8b5-31bd-49eb-9e1c-ec351ea2ed2b req-b90dbe19-090f-4010-bd9d-16b3dc5eb0c1 service nova] Enqueued Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 731.546969] env[65136]: INFO networking_nsxv3.common.synchronization [req-9184a8b5-31bd-49eb-9e1c-ec351ea2ed2b req-b90dbe19-090f-4010-bd9d-16b3dc5eb0c1 service nova] Enqueued Resource ID: a185c15b-fd8e-423e-8117-c00075004d55 with Priority: HIGHEST for action port [ 731.547496] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_rules [ 731.547645] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 731.547759] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a185c15b-fd8e-423e-8117-c00075004d55 with Priority: HIGHEST for action port [ 731.548066] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.548169] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.548413] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.548677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.549594] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-a185c15b-fd8e-423e-8117-c00075004d55 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.549594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a185c15b-fd8e-423e-8117-c00075004d55" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.549594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a185c15b-fd8e-423e-8117-c00075004d55" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.549594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a185c15b-fd8e-423e-8117-c00075004d55" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.549594] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a185c15b-fd8e-423e-8117-c00075004d55',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.902208] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 731.902334] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb deletion is rescheduled due to dependency. [ 731.902865] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.056727] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a185c15b-fd8e-423e-8117-c00075004d55 with status ACTIVE [ 732.058610] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.058871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.058871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.059178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.059371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.059582] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.059708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.059782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.059996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.060111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.060308] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.060433] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.060471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.060693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.060804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.060945] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a185c15b-fd8e-423e-8117-c00075004d55 is going to be updated. [ 732.090524] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.090794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.090794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.090993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.091150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.091315] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a185c15b-fd8e-423e-8117-c00075004d55" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.128540] env[65136]: INFO networking_nsxv3.common.synchronization [req-27e0ca22-ac6d-48cf-90b9-3f7664dbf1b5 req-a8e5341b-14d0-4b78-97cc-957845d2f6ad tempest-ImagesTestJSON-1051903205 tempest-ImagesTestJSON-1051903205-project-member] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 732.129264] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 732.129630] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.129760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.129835] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.134594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.134973] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.135182] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.135405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.135568] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.135708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.135861] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.547242] env[65136]: INFO networking_nsxv3.common.synchronization [None req-cc4aea03-5741-4857-94e8-86272273ae9f None None] Enqueued Resource ID: 7e0fb5b4-e1c4-4f8d-ac69-08b3c9a04984 with Priority: HIGHEST for action port [ 732.547479] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e0fb5b4-e1c4-4f8d-ac69-08b3c9a04984 with Priority: HIGHEST for action port [ 732.547813] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e0fb5b4-e1c4-4f8d-ac69-08b3c9a04984 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.547934] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e0fb5b4-e1c4-4f8d-ac69-08b3c9a04984" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.548014] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e0fb5b4-e1c4-4f8d-ac69-08b3c9a04984" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.548466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e0fb5b4-e1c4-4f8d-ac69-08b3c9a04984" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.548567] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e0fb5b4-e1c4-4f8d-ac69-08b3c9a04984',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.629887] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: SUCCESS [ 732.630202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.630450] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.630794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.631078] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.631257] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.631760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.631760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.631760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.631760] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.638929] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.639200] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.639393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.639602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.639724] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.639994] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.640127] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.640226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.640415] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.640524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.640639] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 already deleted. [ 732.640780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.653520] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-63 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.653520] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.653520] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.654187] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.654983] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.655205] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.655359] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.655632] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.655789] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.656011] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.657683] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.657683] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.657683] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.657683] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.657683] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.657683] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.677734] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.677734] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 732.677854] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.677973] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.678363] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-985aeb3c-bab9-46e3-9cdf-a7399017e740 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.678544] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-985aeb3c-bab9-46e3-9cdf-a7399017e740" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.678746] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-985aeb3c-bab9-46e3-9cdf-a7399017e740" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.679087] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-985aeb3c-bab9-46e3-9cdf-a7399017e740" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.679682] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('985aeb3c-bab9-46e3-9cdf-a7399017e740',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.051349] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e0fb5b4-e1c4-4f8d-ac69-08b3c9a04984 [ 733.051349] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.051545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.051545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.052236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.052236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.052236] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e0fb5b4-e1c4-4f8d-ac69-08b3c9a04984 already deleted. [ 733.052236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e0fb5b4-e1c4-4f8d-ac69-08b3c9a04984" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.135434] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.182366] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.182649] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.182752] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.182993] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.183162] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.183310] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 985aeb3c-bab9-46e3-9cdf-a7399017e740 not found, creating... [ 733.183570] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.183723] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.183835] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.184065] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.184199] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.184476] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.184623] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.184733] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.185045] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.185185] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.185327] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 985aeb3c-bab9-46e3-9cdf-a7399017e740 is going to be created. [ 733.211071] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.211071] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.211071] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.211071] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.211514] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.211514] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-985aeb3c-bab9-46e3-9cdf-a7399017e740" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.637817] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.909741] env[65136]: INFO networking_nsxv3.common.synchronization [req-27e0ca22-ac6d-48cf-90b9-3f7664dbf1b5 req-ce5e69bd-2703-4e8b-89a9-bbad179036a2 service nova] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_rules [ 733.909741] env[65136]: INFO networking_nsxv3.common.synchronization [req-27e0ca22-ac6d-48cf-90b9-3f7664dbf1b5 req-ce5e69bd-2703-4e8b-89a9-bbad179036a2 service nova] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 733.909741] env[65136]: INFO networking_nsxv3.common.synchronization [req-27e0ca22-ac6d-48cf-90b9-3f7664dbf1b5 req-ce5e69bd-2703-4e8b-89a9-bbad179036a2 service nova] Enqueued Resource ID: 985aeb3c-bab9-46e3-9cdf-a7399017e740 with Priority: HIGHEST for action port [ 733.909952] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_rules [ 733.910151] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 733.910267] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 985aeb3c-bab9-46e3-9cdf-a7399017e740 with Priority: HIGHEST for action port [ 733.910528] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.910654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.910711] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.911168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.911282] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.912405] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.912482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.912532] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.912727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.912934] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.912999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.913115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.913254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.913301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.913393] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.914269] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-985aeb3c-bab9-46e3-9cdf-a7399017e740 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.914608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-985aeb3c-bab9-46e3-9cdf-a7399017e740" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.914678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-985aeb3c-bab9-46e3-9cdf-a7399017e740" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.914960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-985aeb3c-bab9-46e3-9cdf-a7399017e740" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.917675] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('985aeb3c-bab9-46e3-9cdf-a7399017e740',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.141122] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.141596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.141709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.142144] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.142246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.142419] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287b8551-3bf8-4455-afb3-b406697983a1 is going to be updated. [ 734.179457] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.179726] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.179920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.180220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.180440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.195431] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: IN_PROGRESS for 2s [ 734.417305] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.417405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.417596] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.418572] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 985aeb3c-bab9-46e3-9cdf-a7399017e740 with status ACTIVE [ 734.418784] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.418901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.418983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.419203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.419351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.419468] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.419559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.419559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.419926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.419926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.420154] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.420217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.420281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.420415] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.420492] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.420665] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 985aeb3c-bab9-46e3-9cdf-a7399017e740 is going to be updated. [ 734.443860] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.444070] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.444110] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.444331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.444470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.444628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-985aeb3c-bab9-46e3-9cdf-a7399017e740" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.467370] env[65136]: INFO networking_nsxv3.common.synchronization [req-41febd49-60a4-4dad-a9a8-da399a373202 req-50528e99-b9f9-45d0-a98b-c7d73b28a4af tempest-ServerRescueTestJSON-1597968343 tempest-ServerRescueTestJSON-1597968343-project-member] Enqueued Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_members [ 734.469070] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_members [ 734.469414] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-246d2702-c0f1-4486-92fb-beb4b3b1950e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.469543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.469613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.469982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.470047] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.470180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.470245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.470408] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.470497] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.470591] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.922398] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.974221] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.974395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.974537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.974706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.974803] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.975011] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.975116] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.975180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.975934] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.976135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.976316] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e already deleted. [ 734.976470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.980203] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-722 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.980418] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-722" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.980595] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-722" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.980908] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-722" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.981231] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.981434] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.981569] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.981802] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.981965] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.982218] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 734.982351] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 734.982477] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 734.982602] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 734.982731] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 734.982867] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 734.983038] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.005199] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.005365] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 735.005500] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.005675] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-722" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.005995] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-aa50be9c-c9ab-45a1-aa4d-4abe85471f0f taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.006356] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-aa50be9c-c9ab-45a1-aa4d-4abe85471f0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.006511] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-aa50be9c-c9ab-45a1-aa4d-4abe85471f0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.006851] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-aa50be9c-c9ab-45a1-aa4d-4abe85471f0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.006992] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa50be9c-c9ab-45a1-aa4d-4abe85471f0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.428277] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.428462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.428534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.428796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.428896] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.429011] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be created. [ 735.457144] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.457409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.457409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.457615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.457783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.469296] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: UNINITIALIZED for 2s [ 735.511208] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.511639] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.511805] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.512138] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.512331] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.512513] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port aa50be9c-c9ab-45a1-aa4d-4abe85471f0f not found, creating... [ 735.513229] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.513229] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.513229] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.513565] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.513750] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.514144] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.514367] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.514493] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.514749] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.514949] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.515130] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: aa50be9c-c9ab-45a1-aa4d-4abe85471f0f is going to be created. [ 735.536870] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.537170] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.537306] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.537573] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.537797] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.538158] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-aa50be9c-c9ab-45a1-aa4d-4abe85471f0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.206491] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: SUCCESS [ 736.206861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.207019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.207290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.208041] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.208041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.208041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.208041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.208041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.208524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.208524] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.208524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.208524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.208898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.208898] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.209012] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.209012] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.209179] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.209213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.209273] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.209378] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.210370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.210578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.210743] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.210847] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.210928] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.211102] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.211183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.211287] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.327030] env[65136]: INFO networking_nsxv3.common.synchronization [req-41febd49-60a4-4dad-a9a8-da399a373202 req-ae2f0898-5bbd-4368-8091-d6ac94ade25b service nova] Enqueued Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_rules [ 736.327030] env[65136]: INFO networking_nsxv3.common.synchronization [req-41febd49-60a4-4dad-a9a8-da399a373202 req-ae2f0898-5bbd-4368-8091-d6ac94ade25b service nova] Enqueued Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_members [ 736.327030] env[65136]: INFO networking_nsxv3.common.synchronization [req-41febd49-60a4-4dad-a9a8-da399a373202 req-ae2f0898-5bbd-4368-8091-d6ac94ade25b service nova] Enqueued Resource ID: aa50be9c-c9ab-45a1-aa4d-4abe85471f0f with Priority: HIGHEST for action port [ 736.327030] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_rules [ 736.327539] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_members [ 736.327539] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa50be9c-c9ab-45a1-aa4d-4abe85471f0f with Priority: HIGHEST for action port [ 736.327697] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-246d2702-c0f1-4486-92fb-beb4b3b1950e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.327859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.327941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.328293] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.328384] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.329961] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-246d2702-c0f1-4486-92fb-beb4b3b1950e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.330073] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.330176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.330467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.330746] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.330955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.332128] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.332128] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.332128] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.332128] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.333440] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa50be9c-c9ab-45a1-aa4d-4abe85471f0f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.333440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa50be9c-c9ab-45a1-aa4d-4abe85471f0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.333440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa50be9c-c9ab-45a1-aa4d-4abe85471f0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.334926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa50be9c-c9ab-45a1-aa4d-4abe85471f0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.334926] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa50be9c-c9ab-45a1-aa4d-4abe85471f0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.713524] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 287b8551-3bf8-4455-afb3-b406697983a1: rpc.has_security_group_logging(os_id): False [ 736.715952] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.735942] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.736287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.736287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.736496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.736586] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.737579] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.737579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.737579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.737579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.737579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.737579] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.737579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.737579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.737996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.740703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.740703] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.740703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.740703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.740703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.740703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.740703] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 287b8551-3bf8-4455-afb3-b406697983a1 is going to be created. [ 736.810022] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.810022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.810022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.810022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.810022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.821546] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: IN_PROGRESS for 2s [ 736.837268] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa50be9c-c9ab-45a1-aa4d-4abe85471f0f with status ACTIVE [ 736.837578] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.837578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.837578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.838116] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.838116] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.838116] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.838778] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.838778] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.838778] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.838778] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.840314] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.840440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.840648] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.840726] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.840764] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.840960] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa50be9c-c9ab-45a1-aa4d-4abe85471f0f is going to be updated. [ 736.842012] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-246d2702-c0f1-4486-92fb-beb4b3b1950e taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.842173] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.842341] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.869246] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.869246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.869246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.869514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.870182] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.870182] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa50be9c-c9ab-45a1-aa4d-4abe85471f0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.220653] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.344943] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.481948] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 737.482281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.482529] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.483521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.483521] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.483521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.483521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.483773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.483897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.484019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.484118] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.691373] env[65136]: INFO networking_nsxv3.common.synchronization [None req-ba3a835f-c5a6-4443-8970-72937fd18134 None None] Enqueued Resource ID: 112d0d7d-3c40-4d23-b032-1a59f1742515 with Priority: HIGHEST for action port [ 737.692141] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 112d0d7d-3c40-4d23-b032-1a59f1742515 with Priority: HIGHEST for action port [ 737.692608] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-112d0d7d-3c40-4d23-b032-1a59f1742515 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.692999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-112d0d7d-3c40-4d23-b032-1a59f1742515" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.693159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-112d0d7d-3c40-4d23-b032-1a59f1742515" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.693508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-112d0d7d-3c40-4d23-b032-1a59f1742515" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.693639] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('112d0d7d-3c40-4d23-b032-1a59f1742515',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.724514] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.724729] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.724839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.725190] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.725314] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.725458] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287b8551-3bf8-4455-afb3-b406697983a1 is going to be updated. [ 737.756685] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.756919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.757046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.757371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.757582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.769086] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: IN_PROGRESS for 2s [ 737.848896] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.849130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.849175] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.849406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.849500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.849600] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e is going to be created. [ 737.877752] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.877939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.877980] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.878674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.878674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.893033] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e in Status: UNINITIALIZED for 2s [ 737.987303] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.987536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.987616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.987899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.988107] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.988278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.988367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.988548] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.988656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.988797] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.988999] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.989114] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.989223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.989331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.989525] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.989623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.989686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.989830] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.989910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.990046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.990146] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.198407] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 112d0d7d-3c40-4d23-b032-1a59f1742515 [ 738.198827] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.198898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.198965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.199191] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.199287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.199385] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:112d0d7d-3c40-4d23-b032-1a59f1742515 already deleted. [ 738.199467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-112d0d7d-3c40-4d23-b032-1a59f1742515" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.493321] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15: rpc.has_security_group_logging(os_id): False [ 738.512864] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.513086] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.513189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.513475] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.513620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.513926] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.514100] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.514188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.514399] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.514512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.514884] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.514884] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.514995] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.515535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.515655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.515910] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.516055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.516145] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.516350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.516473] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.516596] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be created. [ 738.584627] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.584627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.584627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.585289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.585566] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.599871] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 738.709891] env[65136]: INFO networking_nsxv3.common.synchronization [req-4b779823-4063-4ffc-bd93-d31ec2b94f25 req-e77ccaa8-c51d-433f-96c1-f1d6bd578bdd tempest-ServersAdminNegativeTestJSON-1000543325 tempest-ServersAdminNegativeTestJSON-1000543325-project-member] Enqueued Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_members [ 738.709891] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_members [ 738.710173] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-39322202-687d-409e-86ef-4870f36135e8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.711029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.711245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.711703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.712039] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.712290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.712469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.712757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.714201] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.714201] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.839543] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: SUCCESS [ 738.840974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.840974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.840974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.840974] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.215968] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.343176] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.343317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.508417] env[65136]: INFO networking_nsxv3.common.synchronization [req-70bb193a-fcf2-4e31-964f-fdd8059460d7 req-668d288f-49ad-4603-b4e8-529b3744c805 tempest-ServersNegativeTestJSON-605919058 tempest-ServersNegativeTestJSON-605919058-project-member] Enqueued Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_members [ 739.508936] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_members [ 739.509346] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.509490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.509561] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.511208] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.511208] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.511345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.511345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.511499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.511544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.511640] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.719668] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.786549] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: SUCCESS [ 739.786926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.787496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.787496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.787496] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.787659] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.787692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.787979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.788109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.791061] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.903747] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e in Status: SUCCESS [ 739.906025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.906025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.906025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.906025] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.906025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.906025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.906025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.906025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.906025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.906025] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.013433] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.221813] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.222085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.222085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.222237] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.222331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.222473] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39322202-687d-409e-86ef-4870f36135e8 is going to be updated. [ 740.258100] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.258304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.259033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.259033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.259033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.271948] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39322202-687d-409e-86ef-4870f36135e8 in Status: IN_PROGRESS for 2s [ 740.294947] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.403514] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-84 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.403746] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-84" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.403878] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-84" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.404166] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-84" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.405064] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.405637] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.405805] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.406169] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.406398] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.406637] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.407122] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.407122] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.407122] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.407335] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.407335] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.407440] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.409222] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-246d2702-c0f1-4486-92fb-beb4b3b1950e taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.410222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.410222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.410222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.410222] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.410222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.410222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.410575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.410575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.410575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.410795] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-246d2702-c0f1-4486-92fb-beb4b3b1950e taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.410901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.410970] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.411125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.411278] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.411381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.411437] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.411576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.411658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.411743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.411836] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.433682] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.433865] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 740.434111] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.434207] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-84" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.434471] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-8a9cfe85-a99a-48c0-9922-9a06806a331d taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.434648] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-8a9cfe85-a99a-48c0-9922-9a06806a331d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.435222] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-8a9cfe85-a99a-48c0-9922-9a06806a331d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.435222] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-8a9cfe85-a99a-48c0-9922-9a06806a331d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.435505] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a9cfe85-a99a-48c0-9922-9a06806a331d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.516159] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.614738] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 740.614738] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.777203] env[65136]: INFO networking_nsxv3.common.synchronization [None req-2f5bc697-5257-442c-b6de-6ad46b22624f None None] Enqueued Resource ID: a81f0623-6606-4f6b-baf0-f9865a84231a with Priority: HIGHEST for action port [ 740.777203] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a81f0623-6606-4f6b-baf0-f9865a84231a with Priority: HIGHEST for action port [ 740.777428] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-a81f0623-6606-4f6b-baf0-f9865a84231a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.777885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a81f0623-6606-4f6b-baf0-f9865a84231a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.778085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a81f0623-6606-4f6b-baf0-f9865a84231a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.780426] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a81f0623-6606-4f6b-baf0-f9865a84231a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.780426] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a81f0623-6606-4f6b-baf0-f9865a84231a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.797557] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.916075] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 246d2702-c0f1-4486-92fb-beb4b3b1950e: rpc.has_security_group_logging(os_id): False [ 740.934942] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.935110] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.935225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.935519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.935608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.935800] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.935920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.936034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.936316] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.936504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.936631] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.936757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.936830] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.936995] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.937091] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.937298] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.937408] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.937472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.937618] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.937692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.937776] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e is going to be created. [ 740.939201] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.939371] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.939488] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.939694] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.939823] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.939980] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 8a9cfe85-a99a-48c0-9922-9a06806a331d not found, creating... [ 740.940358] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.940597] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.940762] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.941058] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.941240] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.941557] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.941711] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.941823] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.942058] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.942188] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.942317] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 8a9cfe85-a99a-48c0-9922-9a06806a331d is going to be created. [ 740.962495] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.962693] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.962955] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.963082] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.963426] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.963763] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-8a9cfe85-a99a-48c0-9922-9a06806a331d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.018802] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.018958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.018958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.019336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.019336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.019336] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b is going to be updated. [ 741.023766] env[65136]: INFO networking_nsxv3.common.synchronization [None req-2e49289a-ef74-4647-850f-534edf4ea74e None None] Enqueued Resource ID: e4bc4fce-90b5-4df6-9182-e3e7ad0ceab7 with Priority: HIGHEST for action port [ 741.024913] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.025231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.025231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.025417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.025591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.027782] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4bc4fce-90b5-4df6-9182-e3e7ad0ceab7 with Priority: HIGHEST for action port [ 741.028376] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4bc4fce-90b5-4df6-9182-e3e7ad0ceab7 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.028556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4bc4fce-90b5-4df6-9182-e3e7ad0ceab7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.028671] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4bc4fce-90b5-4df6-9182-e3e7ad0ceab7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.029743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4bc4fce-90b5-4df6-9182-e3e7ad0ceab7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.029851] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4bc4fce-90b5-4df6-9182-e3e7ad0ceab7',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.046024] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e in Status: IN_PROGRESS for 2s [ 741.088640] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.088820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.088927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.089247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.089505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.102969] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: IN_PROGRESS for 2s [ 741.281951] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a81f0623-6606-4f6b-baf0-f9865a84231a [ 741.282594] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.282977] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.282977] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.283474] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.283625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.283703] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a81f0623-6606-4f6b-baf0-f9865a84231a already deleted. [ 741.283832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a81f0623-6606-4f6b-baf0-f9865a84231a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.301459] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.301651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.301725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.302061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.302256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.302311] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287b8551-3bf8-4455-afb3-b406697983a1 is going to be updated. [ 741.345364] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.345554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.345604] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.345821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.345980] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.357544] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: IN_PROGRESS for 2s [ 741.533540] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4bc4fce-90b5-4df6-9182-e3e7ad0ceab7 [ 741.533831] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.533906] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.533945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.534163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.534256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.534964] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4bc4fce-90b5-4df6-9182-e3e7ad0ceab7 already deleted. [ 741.534964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4bc4fce-90b5-4df6-9182-e3e7ad0ceab7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.147125] env[65136]: INFO networking_nsxv3.common.synchronization [req-70bb193a-fcf2-4e31-964f-fdd8059460d7 req-d171276c-d184-4c61-b09f-b763e92382ec service nova] Enqueued Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_rules [ 742.147357] env[65136]: INFO networking_nsxv3.common.synchronization [req-70bb193a-fcf2-4e31-964f-fdd8059460d7 req-d171276c-d184-4c61-b09f-b763e92382ec service nova] Enqueued Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_members [ 742.147499] env[65136]: INFO networking_nsxv3.common.synchronization [req-70bb193a-fcf2-4e31-964f-fdd8059460d7 req-d171276c-d184-4c61-b09f-b763e92382ec service nova] Enqueued Resource ID: 8a9cfe85-a99a-48c0-9922-9a06806a331d with Priority: HIGHEST for action port [ 742.148184] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_rules [ 742.148412] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_members [ 742.148518] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a9cfe85-a99a-48c0-9922-9a06806a331d with Priority: HIGHEST for action port [ 742.148817] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.148947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.149197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.149276] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.149376] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.150690] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.150796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.151036] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a9cfe85-a99a-48c0-9922-9a06806a331d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.151154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a9cfe85-a99a-48c0-9922-9a06806a331d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.151220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a9cfe85-a99a-48c0-9922-9a06806a331d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.151412] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a9cfe85-a99a-48c0-9922-9a06806a331d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.151493] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a9cfe85-a99a-48c0-9922-9a06806a331d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.283207] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39322202-687d-409e-86ef-4870f36135e8 in Status: SUCCESS [ 742.283309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.655305] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.655305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.655305] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a9cfe85-a99a-48c0-9922-9a06806a331d with status ACTIVE [ 742.655305] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.655305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.655305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.655759] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.655759] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.655759] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.655759] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.655873] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.655982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.656043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.656234] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.656330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.656380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.656525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.656600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.656683] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a9cfe85-a99a-48c0-9922-9a06806a331d is going to be updated. [ 742.682206] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.682460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.682460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.682694] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.682847] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.683027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a9cfe85-a99a-48c0-9922-9a06806a331d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.070628] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e in Status: SUCCESS [ 743.070917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.115649] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: SUCCESS [ 743.115649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.115649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.115649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.115649] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.115649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.115649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.115649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.115649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.115649] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.370902] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: SUCCESS [ 743.371167] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.371360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.371744] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.371848] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.371944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.371944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.372175] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.372296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.372388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.372622] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.618992] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.726034] env[65136]: INFO networking_nsxv3.common.synchronization [None req-6561a42d-d078-4948-8bcb-c70c82d2b957 None None] Enqueued Resource ID: 218a3f7b-a285-4968-9910-52f8f36830b0 with Priority: HIGHEST for action port [ 743.726511] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 218a3f7b-a285-4968-9910-52f8f36830b0 with Priority: HIGHEST for action port [ 743.726923] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-218a3f7b-a285-4968-9910-52f8f36830b0 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.728165] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-218a3f7b-a285-4968-9910-52f8f36830b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.728165] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-218a3f7b-a285-4968-9910-52f8f36830b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.728165] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-218a3f7b-a285-4968-9910-52f8f36830b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.728165] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('218a3f7b-a285-4968-9910-52f8f36830b0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.875363] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.875570] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.875612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.875849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.876047] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.876184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.876255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.876407] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.876496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.876583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.876748] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.876842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.876903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.877054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.877191] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.877271] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.877353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.877457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.877528] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.877606] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.877696] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.122305] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.232191] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 218a3f7b-a285-4968-9910-52f8f36830b0 [ 744.232420] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.232575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.232655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.234290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.234290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.234290] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:218a3f7b-a285-4968-9910-52f8f36830b0 already deleted. [ 744.234290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-218a3f7b-a285-4968-9910-52f8f36830b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.379718] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 287b8551-3bf8-4455-afb3-b406697983a1: rpc.has_security_group_logging(os_id): False [ 744.399233] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.399373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.399471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.399752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.399885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.400147] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.400309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.400393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.400636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.400732] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.400978] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.401677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.401749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.401931] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.402151] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.403799] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.403938] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.404281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.404281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.404281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.404453] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 287b8551-3bf8-4455-afb3-b406697983a1 is going to be updated. [ 744.484044] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.484194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.484545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.484545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.484661] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.504979] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: IN_PROGRESS for 2s [ 744.625234] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.625396] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.625469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.625781] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.625886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.625989] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b is going to be updated. [ 744.657551] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.657551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.657551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.657551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.657551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.670988] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: IN_PROGRESS for 2s [ 744.694532] env[65136]: INFO networking_nsxv3.common.synchronization [req-116b53a5-445e-4906-b0e1-4f70721e380a req-0d1acc19-db58-4a59-88ba-5187feb7792d tempest-MigrationsAdminTest-368591407 tempest-MigrationsAdminTest-368591407-project-member] Enqueued Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_members [ 744.694912] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_members [ 744.697067] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a04e899-b185-4f20-8eea-e0edb95feabb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.697067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.697067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.697067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.697067] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.697067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.697067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.697067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.697067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.697067] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.187813] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.187813] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.187813] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.187813] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.188225] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.188225] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.188225] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.188447] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.188586] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.188783] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.188892] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.189016] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.192374] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.192374] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 745.192374] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.192374] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.199699] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.214658] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.214658] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 745.214658] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.214906] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.215298] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-be6cb282-4d17-4acc-93aa-e3c7dd89459b taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.215298] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-be6cb282-4d17-4acc-93aa-e3c7dd89459b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.215426] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-be6cb282-4d17-4acc-93aa-e3c7dd89459b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.216089] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-be6cb282-4d17-4acc-93aa-e3c7dd89459b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.216089] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be6cb282-4d17-4acc-93aa-e3c7dd89459b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.701207] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.719093] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.719316] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.719464] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.719727] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.719873] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.720242] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port be6cb282-4d17-4acc-93aa-e3c7dd89459b not found, creating... [ 745.720309] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.720455] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.720574] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.720855] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.721042] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.721420] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.721609] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.721727] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.721924] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.722071] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.722207] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: be6cb282-4d17-4acc-93aa-e3c7dd89459b is going to be created. [ 745.744228] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.744228] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.744340] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.744525] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.744742] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.744956] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-be6cb282-4d17-4acc-93aa-e3c7dd89459b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.207476] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.207476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.207476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.207476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.207476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.207476] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a04e899-b185-4f20-8eea-e0edb95feabb is going to be updated. [ 746.246787] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.246787] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.246926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.247050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.247213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.258915] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a04e899-b185-4f20-8eea-e0edb95feabb in Status: IN_PROGRESS for 2s [ 746.518025] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: SUCCESS [ 746.518025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.518025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.518354] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.518476] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.546077] env[65136]: INFO networking_nsxv3.common.synchronization [req-116b53a5-445e-4906-b0e1-4f70721e380a req-dc114d77-8a3b-4dcb-ab2a-c71ebb31016f service nova] Enqueued Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_rules [ 746.546077] env[65136]: INFO networking_nsxv3.common.synchronization [req-116b53a5-445e-4906-b0e1-4f70721e380a req-dc114d77-8a3b-4dcb-ab2a-c71ebb31016f service nova] Enqueued Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_members [ 746.546077] env[65136]: INFO networking_nsxv3.common.synchronization [req-116b53a5-445e-4906-b0e1-4f70721e380a req-dc114d77-8a3b-4dcb-ab2a-c71ebb31016f service nova] Enqueued Resource ID: be6cb282-4d17-4acc-93aa-e3c7dd89459b with Priority: HIGHEST for action port [ 746.548722] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_rules [ 746.548910] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_members [ 746.549056] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: be6cb282-4d17-4acc-93aa-e3c7dd89459b with Priority: HIGHEST for action port [ 746.549483] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a04e899-b185-4f20-8eea-e0edb95feabb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.549651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.549754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.550029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.550604] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.551692] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a04e899-b185-4f20-8eea-e0edb95feabb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.551692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.551840] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-be6cb282-4d17-4acc-93aa-e3c7dd89459b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.551907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-be6cb282-4d17-4acc-93aa-e3c7dd89459b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.551973] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-be6cb282-4d17-4acc-93aa-e3c7dd89459b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.552231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-be6cb282-4d17-4acc-93aa-e3c7dd89459b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.552404] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('be6cb282-4d17-4acc-93aa-e3c7dd89459b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.681013] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: SUCCESS [ 746.681013] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.681013] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.681013] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.681289] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.681289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.681397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.681674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.681674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.681762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.682395] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.023355] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.023583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.023690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.024084] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.024680] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.024680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.024680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.024680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.024805] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.025181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.025181] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.057047] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a04e899-b185-4f20-8eea-e0edb95feabb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.057047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.057047] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port be6cb282-4d17-4acc-93aa-e3c7dd89459b with status ACTIVE [ 747.057047] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.057047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.057047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.057047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.057047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.057047] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.057047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.057047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.057576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.057576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.057576] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.057576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.057576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.057769] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.058024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.058024] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: be6cb282-4d17-4acc-93aa-e3c7dd89459b is going to be updated. [ 747.088588] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.088588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.088588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.088868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.088868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.088975] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-be6cb282-4d17-4acc-93aa-e3c7dd89459b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.112091] env[65136]: INFO networking_nsxv3.common.synchronization [req-6a263e1f-27c2-4e8c-b091-3bce6b138f34 req-7724c5c9-81df-44c5-98df-3baffa5b3e77 tempest-ServersAdminTestJSON-92432023 tempest-ServersAdminTestJSON-92432023-project-member] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 747.113204] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 747.113854] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.114216] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.114453] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.116020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.116020] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.116020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.116020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.116020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.116020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.116020] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.184666] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.184666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.184889] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.185023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.185257] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.185468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.185555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.185858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.186016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.186204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.186452] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.186591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.186680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.186855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.187113] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.187312] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.187458] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.187678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.187772] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.187903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.188043] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.529159] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.529551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.529551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.529551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.529784] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.529870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.529910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.530166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.530166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.530289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.530363] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.530473] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.530519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.530824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.530824] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.530944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.530944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.531042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.531109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.531191] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.531281] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.594114] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-718 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.594380] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.594549] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.594956] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.595566] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.596128] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.596419] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.596806] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.596999] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.597296] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.597477] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 747.597744] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 747.597744] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 747.597936] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 747.598109] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 747.598361] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 747.619596] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.622617] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 747.623671] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 747.623671] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 747.623671] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-718" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.623671] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-75a22e96-f669-4c54-a310-ff2e4c66c032 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.623671] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-75a22e96-f669-4c54-a310-ff2e4c66c032" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.624114] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-75a22e96-f669-4c54-a310-ff2e4c66c032" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.624379] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-75a22e96-f669-4c54-a310-ff2e4c66c032" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.624516] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75a22e96-f669-4c54-a310-ff2e4c66c032',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.691293] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b: rpc.has_security_group_logging(os_id): False [ 747.720736] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.720902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.720977] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.721212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.721311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.721507] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.721608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.721676] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.721824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.721902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.722123] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.722220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.722293] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.722468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.722554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.722724] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.722813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.722871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.723023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.723097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.723196] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b is going to be updated. [ 747.813034] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.813034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.813034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.813034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.813034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.826830] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: IN_PROGRESS for 2s [ 748.037364] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 287b8551-3bf8-4455-afb3-b406697983a1: rpc.has_security_group_logging(os_id): False [ 748.059527] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.059844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.059844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.060143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.060253] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.060517] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.060655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.060782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.060990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.061094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.061351] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.061466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.061525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.061756] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.061850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.062083] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.062212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.062252] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.062384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.062476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.062565] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 287b8551-3bf8-4455-afb3-b406697983a1 is going to be updated. [ 748.121649] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.126571] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.127456] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.127456] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.127456] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.127456] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.127647] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 75a22e96-f669-4c54-a310-ff2e4c66c032 not found, creating... [ 748.127797] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.127953] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.128080] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.128333] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.128476] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.128761] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.129013] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.129081] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.129350] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.129492] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.129629] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 75a22e96-f669-4c54-a310-ff2e4c66c032 is going to be created. [ 748.139301] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.139521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.139521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.139903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.140029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.163035] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: IN_PROGRESS for 2s [ 748.164162] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.164162] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.164524] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.164620] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.165225] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.165344] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-75a22e96-f669-4c54-a310-ff2e4c66c032" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.279601] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a04e899-b185-4f20-8eea-e0edb95feabb in Status: SUCCESS [ 748.279601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.279601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.279877] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.280275] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.280473] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.280653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.280986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.281205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.281385] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.624790] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.625114] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.625114] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.625214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.625305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.625411] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be updated. [ 748.666404] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.666548] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.666623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.666838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.667485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.677677] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: IN_PROGRESS for 2s [ 748.738171] env[65136]: INFO networking_nsxv3.common.synchronization [None req-7d66b6fd-b580-4e06-bf38-a49aedc29ca4 None None] Enqueued Resource ID: c19e146b-3e1e-4fa0-b63a-7fe300d901fc with Priority: HIGHEST for action port [ 748.739033] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c19e146b-3e1e-4fa0-b63a-7fe300d901fc with Priority: HIGHEST for action port [ 748.739646] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-c19e146b-3e1e-4fa0-b63a-7fe300d901fc taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.740119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c19e146b-3e1e-4fa0-b63a-7fe300d901fc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.740119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c19e146b-3e1e-4fa0-b63a-7fe300d901fc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.740311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c19e146b-3e1e-4fa0-b63a-7fe300d901fc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.740311] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c19e146b-3e1e-4fa0-b63a-7fe300d901fc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.785044] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.910792] env[65136]: INFO networking_nsxv3.common.synchronization [req-6a263e1f-27c2-4e8c-b091-3bce6b138f34 req-3095c796-48a7-4d26-8c85-42014866cd2c service nova] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_rules [ 748.910994] env[65136]: INFO networking_nsxv3.common.synchronization [req-6a263e1f-27c2-4e8c-b091-3bce6b138f34 req-3095c796-48a7-4d26-8c85-42014866cd2c service nova] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 748.911166] env[65136]: INFO networking_nsxv3.common.synchronization [req-6a263e1f-27c2-4e8c-b091-3bce6b138f34 req-3095c796-48a7-4d26-8c85-42014866cd2c service nova] Enqueued Resource ID: 75a22e96-f669-4c54-a310-ff2e4c66c032 with Priority: HIGHEST for action port [ 748.912956] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_rules [ 748.912956] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 748.913092] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75a22e96-f669-4c54-a310-ff2e4c66c032 with Priority: HIGHEST for action port [ 748.913448] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.913646] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.913717] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.914024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.914185] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.915751] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.916237] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.918793] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-75a22e96-f669-4c54-a310-ff2e4c66c032 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.918793] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75a22e96-f669-4c54-a310-ff2e4c66c032" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.918793] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75a22e96-f669-4c54-a310-ff2e4c66c032" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.918793] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75a22e96-f669-4c54-a310-ff2e4c66c032" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.918793] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75a22e96-f669-4c54-a310-ff2e4c66c032',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.243415] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c19e146b-3e1e-4fa0-b63a-7fe300d901fc [ 749.244148] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.244148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.244148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.244148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.244395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.244395] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c19e146b-3e1e-4fa0-b63a-7fe300d901fc already deleted. [ 749.244395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c19e146b-3e1e-4fa0-b63a-7fe300d901fc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.286481] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.417557] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.417557] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.428111] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75a22e96-f669-4c54-a310-ff2e4c66c032 with status ACTIVE [ 749.428111] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.428111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.428111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.428111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.428111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.428111] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.429154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.429154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.429154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.429154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.429154] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.429154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.429154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.429378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.429378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.429429] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75a22e96-f669-4c54-a310-ff2e4c66c032 is going to be updated. [ 749.456714] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.456714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.456714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.456714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.456714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.457084] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75a22e96-f669-4c54-a310-ff2e4c66c032" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.788975] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.789564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.789564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.789564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.789700] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.789743] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a04e899-b185-4f20-8eea-e0edb95feabb is going to be updated. [ 749.835651] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.835916] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.835993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.836227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.836449] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.847306] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: SUCCESS [ 749.847689] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.849852] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a04e899-b185-4f20-8eea-e0edb95feabb in Status: IN_PROGRESS for 2s [ 750.180038] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: SUCCESS [ 750.180380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.693097] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 750.693342] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.693553] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.693981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.694162] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.694417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.694483] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.694714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.694806] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.695025] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.197453] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.522648] env[65136]: INFO networking_nsxv3.common.synchronization [None req-0166747d-5c2d-4bc7-98bb-da7502d7823a None None] Enqueued Resource ID: 67b76a42-4ee7-42ca-913b-c7c2a76ea7a9 with Priority: HIGHEST for action port [ 751.525808] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67b76a42-4ee7-42ca-913b-c7c2a76ea7a9 with Priority: HIGHEST for action port [ 751.525808] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-67b76a42-4ee7-42ca-913b-c7c2a76ea7a9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.525808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67b76a42-4ee7-42ca-913b-c7c2a76ea7a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.525808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67b76a42-4ee7-42ca-913b-c7c2a76ea7a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.525808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67b76a42-4ee7-42ca-913b-c7c2a76ea7a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.525808] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67b76a42-4ee7-42ca-913b-c7c2a76ea7a9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.700431] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.864159] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a04e899-b185-4f20-8eea-e0edb95feabb in Status: SUCCESS [ 751.864159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.864159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.864487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.864807] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.864932] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.865011] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.865276] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.865276] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.865480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.865480] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.027237] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67b76a42-4ee7-42ca-913b-c7c2a76ea7a9 [ 752.027962] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.027962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.027962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.028752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.028752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.028752] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67b76a42-4ee7-42ca-913b-c7c2a76ea7a9 already deleted. [ 752.028752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67b76a42-4ee7-42ca-913b-c7c2a76ea7a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.206895] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.206895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.206895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.207574] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.207674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.207970] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be updated. [ 752.263406] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.263606] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.263606] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.264212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.264421] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.278449] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: IN_PROGRESS for 2s [ 752.369924] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a04e899-b185-4f20-8eea-e0edb95feabb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.373029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.373029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.373029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.373029] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.373029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.373029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.373029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.373029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.373029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.373029] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a04e899-b185-4f20-8eea-e0edb95feabb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.373029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.373029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.373029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.373029] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.373029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.373029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.373029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.373029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.373891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.373891] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.378245] env[65136]: INFO networking_nsxv3.common.synchronization [req-2f63e275-4167-43f1-9dd0-c69d3f35a73d req-de2cdf44-d85c-46d5-844e-fc7d0f643a0f tempest-DeleteServersTestJSON-1045367082 tempest-DeleteServersTestJSON-1045367082-project-member] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 752.379819] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 752.380307] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.380665] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.380810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.381154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.381411] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.381616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.382069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.382754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.382944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.385641] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.662382] env[65136]: INFO networking_nsxv3.common.synchronization [None req-03458445-38b2-4204-8dbb-902b1d8c15d9 None None] Enqueued Resource ID: b8ab7d20-dace-4f1f-9de8-a585da8ff561 with Priority: HIGHEST for action port [ 752.662382] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ab7d20-dace-4f1f-9de8-a585da8ff561 with Priority: HIGHEST for action port [ 752.662382] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8ab7d20-dace-4f1f-9de8-a585da8ff561 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.662382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8ab7d20-dace-4f1f-9de8-a585da8ff561" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.662382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8ab7d20-dace-4f1f-9de8-a585da8ff561" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.664874] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8ab7d20-dace-4f1f-9de8-a585da8ff561" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.664874] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8ab7d20-dace-4f1f-9de8-a585da8ff561',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.861400] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.861679] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.862028] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.862770] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.864011] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.864325] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.864531] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.866038] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.866038] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.866038] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.866038] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.866038] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.866038] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.866038] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.866038] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.866329] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.876415] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a04e899-b185-4f20-8eea-e0edb95feabb: rpc.has_security_group_logging(os_id): False [ 752.886959] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.889181] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.889438] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 752.889500] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.889647] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.889963] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.894027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.894027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.894027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.894027] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.898951] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.900062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.900168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.900387] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.900485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.900706] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.900900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.901049] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.903320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.903320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.903320] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.903320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.903320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.903320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.903320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.903320] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.903320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.903320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.903320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.903320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.903320] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a04e899-b185-4f20-8eea-e0edb95feabb is going to be updated. [ 752.993113] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.993302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.993365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.993561] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.993720] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.009015] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a04e899-b185-4f20-8eea-e0edb95feabb in Status: IN_PROGRESS for 2s [ 753.165947] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8ab7d20-dace-4f1f-9de8-a585da8ff561 [ 753.166310] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.166385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.166419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.166974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.166974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.166974] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8ab7d20-dace-4f1f-9de8-a585da8ff561 already deleted. [ 753.166974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8ab7d20-dace-4f1f-9de8-a585da8ff561" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.395794] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.396135] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.396183] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.396688] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.396940] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.397216] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1 not found, creating... [ 753.397629] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.397832] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.397957] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.398230] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.398470] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.398791] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.398951] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.399078] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.399314] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.399449] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.399586] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1 is going to be created. [ 753.401316] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.428494] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.428494] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.428494] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.428494] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.428494] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.428494] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.906981] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.906981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.906981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.906981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.906981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.906981] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 753.952427] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.952575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.952645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.952974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.953069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.968052] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 754.264163] env[65136]: INFO networking_nsxv3.common.synchronization [req-2f63e275-4167-43f1-9dd0-c69d3f35a73d req-03b481e2-83f6-49c4-9e3d-9be22b4c7ba7 service nova] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_rules [ 754.264347] env[65136]: INFO networking_nsxv3.common.synchronization [req-2f63e275-4167-43f1-9dd0-c69d3f35a73d req-03b481e2-83f6-49c4-9e3d-9be22b4c7ba7 service nova] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 754.264500] env[65136]: INFO networking_nsxv3.common.synchronization [req-2f63e275-4167-43f1-9dd0-c69d3f35a73d req-03b481e2-83f6-49c4-9e3d-9be22b4c7ba7 service nova] Enqueued Resource ID: cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1 with Priority: HIGHEST for action port [ 754.265050] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_rules [ 754.265184] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 754.265286] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1 with Priority: HIGHEST for action port [ 754.265569] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.265685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.265759] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.265972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.266067] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.267070] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.267134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.267316] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.267422] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.267488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.267659] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.267731] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.295996] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 754.295996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.295996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.295996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.295996] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.295996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.295996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.295996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.295996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.295996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.295996] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.769542] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.770397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.770878] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1 with status ACTIVE [ 754.770928] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.771123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.771218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.771459] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.771554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.771919] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.772054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.772120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.772297] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.772369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.772573] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.772652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.772716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.772864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.773097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.773097] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1 is going to be updated. [ 754.801341] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.801597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.801597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.802056] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.802056] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.802056] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.802056] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.802915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.802915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.802915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.802915] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.802915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.803115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.803146] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.803435] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.803435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.803805] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.803805] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.803805] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.804076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.804076] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.809574] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.809574] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.809574] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.809574] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.809753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.809896] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb8431f9-a515-42f4-8cd3-4cb9e4abcaa1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.814131] env[65136]: INFO networking_nsxv3.common.synchronization [req-cc52aabb-1c7e-4898-a0b3-aaa707aedbf1 req-bf34cc74-816f-4a37-bb6c-17ab2533e7cf tempest-ServersAdminNegativeTestJSON-1000543325 tempest-ServersAdminNegativeTestJSON-1000543325-project-member] Enqueued Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_members [ 754.815023] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39322202-687d-409e-86ef-4870f36135e8 with Priority: HIGHEST for action security_group_members [ 754.815452] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-39322202-687d-409e-86ef-4870f36135e8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.815628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.815749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.816033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.816382] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.816530] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.816670] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.816809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.816905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.817016] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('39322202-687d-409e-86ef-4870f36135e8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.986792] env[65136]: INFO networking_nsxv3.common.synchronization [req-dcc2fd9c-7d91-4555-9b80-9f9291a49958 req-ab7897c8-6af9-491b-bc00-40ec5ff410a3 tempest-FloatingIPsAssociationTestJSON-852158796 tempest-FloatingIPsAssociationTestJSON-852158796-project-member] Enqueued Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_members [ 754.988511] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_members [ 754.989065] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.989270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.989502] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.989678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.989884] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.990123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.990232] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.990789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.991021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.991231] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.027852] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a04e899-b185-4f20-8eea-e0edb95feabb in Status: SUCCESS [ 755.028173] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.310259] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 171f535d-ebee-432f-b393-d063259af9b9: rpc.has_security_group_logging(os_id): False [ 755.324556] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.324556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.324556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.324788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.324788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.327225] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.327225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.327225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.327225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.327225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.327225] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39322202-687d-409e-86ef-4870f36135e8 is going to be updated. [ 755.333844] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.334998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.334998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.334998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.334998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.334998] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.334998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.334998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.335474] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.335474] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.335568] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.336461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.336461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.336461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.340949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.340949] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.344460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.344460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.344460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.344460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.344460] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be updated. [ 755.366070] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.366280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.366353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.371430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.371430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.379831] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39322202-687d-409e-86ef-4870f36135e8 in Status: IN_PROGRESS for 2s [ 755.456755] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.456755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.456755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.456755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.456755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.475466] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: IN_PROGRESS for 2s [ 755.496496] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.511367] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-516 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.511597] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-516" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.511682] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-516" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.511959] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-516" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.512972] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.513213] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.513284] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.513591] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.513779] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.517999] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.517999] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.517999] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.517999] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.517999] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.517999] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.517999] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.556774] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.557078] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 755.557275] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.557455] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-516" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.557839] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-629f24bc-3c0e-4462-844e-33b876ff968a taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.558159] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-629f24bc-3c0e-4462-844e-33b876ff968a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.558343] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-629f24bc-3c0e-4462-844e-33b876ff968a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.558793] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-629f24bc-3c0e-4462-844e-33b876ff968a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.560108] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('629f24bc-3c0e-4462-844e-33b876ff968a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.667979] env[65136]: INFO networking_nsxv3.common.synchronization [None req-f40f0cb0-1b13-4042-8ea2-abd427b4dc0c None None] Enqueued Resource ID: 8249d104-7751-4886-9d79-82c460450b62 with Priority: HIGHEST for action port [ 755.668637] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8249d104-7751-4886-9d79-82c460450b62 with Priority: HIGHEST for action port [ 755.668949] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-8249d104-7751-4886-9d79-82c460450b62 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.670662] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8249d104-7751-4886-9d79-82c460450b62" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.670662] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8249d104-7751-4886-9d79-82c460450b62" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.671109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8249d104-7751-4886-9d79-82c460450b62" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.671109] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8249d104-7751-4886-9d79-82c460450b62',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.977167] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 755.977547] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.977592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.977831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.977976] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.978405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.978405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.978405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.978532] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.978581] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.999333] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.067035] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.067282] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.067413] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.067666] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.067813] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.068011] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 629f24bc-3c0e-4462-844e-33b876ff968a not found, creating... [ 756.068310] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.068465] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.068593] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.068855] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.068964] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.069361] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.069567] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.069685] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.069948] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.070096] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.070446] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 629f24bc-3c0e-4462-844e-33b876ff968a is going to be created. [ 756.096611] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.096903] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.096986] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.097254] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.097507] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.097740] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-629f24bc-3c0e-4462-844e-33b876ff968a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.175571] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8249d104-7751-4886-9d79-82c460450b62 [ 756.175850] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.175985] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.176081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.176290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.176401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.176489] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8249d104-7751-4886-9d79-82c460450b62 already deleted. [ 756.176565] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8249d104-7751-4886-9d79-82c460450b62" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.481802] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.503545] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.503803] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.503909] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.504314] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.504314] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.504427] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 is going to be updated. [ 756.542050] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.542281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.542411] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.542746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.542999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.554935] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 in Status: IN_PROGRESS for 2s [ 756.979811] env[65136]: INFO networking_nsxv3.common.synchronization [req-449fe2f6-be3b-4ff1-b05f-e9d7015a0fc8 req-669883c9-d72c-4718-abf8-26cd2f7be523 tempest-ServerDiskConfigTestJSON-1818502390 tempest-ServerDiskConfigTestJSON-1818502390-project-member] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 756.980376] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 756.981728] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.981728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.981728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.981728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.981728] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.981728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.981728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.981728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.981728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.981728] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.984324] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.337128] env[65136]: INFO networking_nsxv3.common.synchronization [req-dcc2fd9c-7d91-4555-9b80-9f9291a49958 req-89a2e986-68c0-4ab4-86d2-7b3c9c13ab61 service nova] Enqueued Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_rules [ 757.337128] env[65136]: INFO networking_nsxv3.common.synchronization [req-dcc2fd9c-7d91-4555-9b80-9f9291a49958 req-89a2e986-68c0-4ab4-86d2-7b3c9c13ab61 service nova] Enqueued Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_members [ 757.337128] env[65136]: INFO networking_nsxv3.common.synchronization [req-dcc2fd9c-7d91-4555-9b80-9f9291a49958 req-89a2e986-68c0-4ab4-86d2-7b3c9c13ab61 service nova] Enqueued Resource ID: 629f24bc-3c0e-4462-844e-33b876ff968a with Priority: HIGHEST for action port [ 757.337128] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_rules [ 757.340323] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_members [ 757.340639] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 629f24bc-3c0e-4462-844e-33b876ff968a with Priority: HIGHEST for action port [ 757.341110] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06b0bf22-61b9-4a96-a3f3-ec08a80369b4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.342028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.342028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.342028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.342028] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.346339] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.346527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.346713] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-629f24bc-3c0e-4462-844e-33b876ff968a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.346931] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-629f24bc-3c0e-4462-844e-33b876ff968a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.347291] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-629f24bc-3c0e-4462-844e-33b876ff968a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.347572] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-629f24bc-3c0e-4462-844e-33b876ff968a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.347726] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('629f24bc-3c0e-4462-844e-33b876ff968a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.396870] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 39322202-687d-409e-86ef-4870f36135e8 in Status: SUCCESS [ 757.396870] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 39322202-687d-409e-86ef-4870f36135e8 deletion is rescheduled due to dependency. [ 757.396870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-39322202-687d-409e-86ef-4870f36135e8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.484380] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.484464] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.484496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.485184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.485184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.485184] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.485184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.485184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.485459] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.485459] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.485459] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be updated. [ 757.486746] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.486913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.487098] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.487376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.488209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.488209] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 757.492385] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 757.492578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.524671] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.524807] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.524920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.525198] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.526541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.527979] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.528157] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.528229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.528525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.528697] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.541201] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 757.542422] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 757.553474] env[65136]: INFO networking_nsxv3.common.synchronization [req-ba88c5db-b874-4814-839b-65465a15b671 req-09499c7d-85b3-4d3b-87ec-3d1b0cdf520b tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 757.554076] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 757.554624] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.554832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.555463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.555463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.555736] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.555935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.556103] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.556410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.556602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.556847] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.850307] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.850307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.850519] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 629f24bc-3c0e-4462-844e-33b876ff968a with status ACTIVE [ 757.850932] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.850932] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.850932] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.851120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.851264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.851499] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.851590] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.851640] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.851816] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.851899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.852099] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.852214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.852256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.852392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.852465] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.852660] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 629f24bc-3c0e-4462-844e-33b876ff968a is going to be updated. [ 757.879524] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.879716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.879716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.880993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.880993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.880993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-629f24bc-3c0e-4462-844e-33b876ff968a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.980505] env[65136]: INFO networking_nsxv3.common.synchronization [req-152c4cf1-766e-4751-b614-3e5538faf9e8 req-3a9517d2-190f-4d79-b48d-eea957c519ea tempest-ServersTestMultiNic-1831982173 tempest-ServersTestMultiNic-1831982173-project-member] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 757.980505] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 757.980505] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.980505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.980505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.980505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.982331] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.982452] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.982517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.982700] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.982787] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.982891] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.060149] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.060276] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.060276] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.060460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.060632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.060829] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.060909] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.060955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.061104] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.061180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.061274] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be updated. [ 758.096248] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.096248] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.096418] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.096575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.096734] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.106946] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: IN_PROGRESS for 2s [ 758.395920] env[65136]: INFO networking_nsxv3.common.synchronization [req-152c4cf1-766e-4751-b614-3e5538faf9e8 req-fc8a1cad-c4e2-4577-ac9b-75c71edc280c tempest-ServersTestMultiNic-1831982173 tempest-ServersTestMultiNic-1831982173-project-member] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 758.396572] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 758.396891] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.397090] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.489549] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.489747] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.489824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.490060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.490156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.490360] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.490482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.490512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.490678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.490754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.490841] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be updated. [ 758.520536] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.522340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.522340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.522340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.522340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.533313] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 758.568350] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 in Status: SUCCESS [ 758.568350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.568350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.568350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.568350] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.568350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.568350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.568693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.568693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.568693] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.874607] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-838 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.874799] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-838" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.874916] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-838" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.875324] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-838" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.876708] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.876708] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.876708] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.876708] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.876708] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.876708] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.876708] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.876708] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.876708] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.877299] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.877299] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.877299] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.903177] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.903363] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 758.903468] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.903631] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-838" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.904058] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-2245c492-46b0-4c79-a676-4d33727a81b1 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.904240] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-2245c492-46b0-4c79-a676-4d33727a81b1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.904700] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-2245c492-46b0-4c79-a676-4d33727a81b1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.904700] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-2245c492-46b0-4c79-a676-4d33727a81b1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.904810] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2245c492-46b0-4c79-a676-4d33727a81b1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.071733] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.406828] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.407054] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.407162] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.407430] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.407563] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.407701] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 2245c492-46b0-4c79-a676-4d33727a81b1 not found, creating... [ 759.407945] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.408093] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.408197] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.408641] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.408788] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.409101] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.409244] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.409565] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.409829] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.409963] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.410122] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 2245c492-46b0-4c79-a676-4d33727a81b1 is going to be created. [ 759.433232] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.433663] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.433790] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.434076] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.434318] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.434536] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-2245c492-46b0-4c79-a676-4d33727a81b1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.553329] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 759.553648] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d deletion is rescheduled due to dependency. [ 759.553648] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.554717] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 759.554903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.555117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.555302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.555503] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.555616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.555696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.555912] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.555966] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.556087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.556191] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.574331] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.058658] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.058962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.059061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.059370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.059659] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.059855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.060033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.060226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.060309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.060458] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.060685] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.060812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.060911] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.064933] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.065179] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.065274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.065496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.065630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.065826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.065956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.066204] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.076636] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.077030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.077030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.077124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.077574] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.077574] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 is going to be updated. [ 760.111088] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.111307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.111307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.111519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.111669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.124563] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 in Status: IN_PROGRESS for 2s [ 760.125430] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 760.125643] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde deletion is rescheduled due to dependency. [ 760.125788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.240555] env[65136]: INFO networking_nsxv3.common.synchronization [req-152c4cf1-766e-4751-b614-3e5538faf9e8 req-efd6e689-aff9-4b80-8e9f-ebd4d47f5df1 service nova] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_rules [ 760.240691] env[65136]: INFO networking_nsxv3.common.synchronization [req-152c4cf1-766e-4751-b614-3e5538faf9e8 req-efd6e689-aff9-4b80-8e9f-ebd4d47f5df1 service nova] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 760.240760] env[65136]: INFO networking_nsxv3.common.synchronization [req-152c4cf1-766e-4751-b614-3e5538faf9e8 req-efd6e689-aff9-4b80-8e9f-ebd4d47f5df1 service nova] Enqueued Resource ID: 2245c492-46b0-4c79-a676-4d33727a81b1 with Priority: HIGHEST for action port [ 760.241461] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_rules [ 760.241626] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 760.241770] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2245c492-46b0-4c79-a676-4d33727a81b1 with Priority: HIGHEST for action port [ 760.242142] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.242142] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.242424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.242424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.242551] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.243761] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.243761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.243892] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-2245c492-46b0-4c79-a676-4d33727a81b1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.243964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2245c492-46b0-4c79-a676-4d33727a81b1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.243964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2245c492-46b0-4c79-a676-4d33727a81b1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.244174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2245c492-46b0-4c79-a676-4d33727a81b1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.244253] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2245c492-46b0-4c79-a676-4d33727a81b1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.547942] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 760.548134] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb deletion is rescheduled due to dependency. [ 760.548232] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.548467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.548673] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.548863] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.548980] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.549056] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.549215] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.549307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.549728] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.568149] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5ef8f7d-8350-4fe2-9bef-70ff70b5f141: rpc.has_security_group_logging(os_id): False [ 760.590574] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.590726] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.590784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.590998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.591149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.591392] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.591518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.591587] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.591752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.591832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.592021] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.592160] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.592205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.592315] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.592391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.592579] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.592672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.594408] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.594603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.594690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.594783] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 760.659800] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.659959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.660042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.660264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.660420] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.675350] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 760.745882] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.746072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.746304] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2245c492-46b0-4c79-a676-4d33727a81b1 with status ACTIVE [ 760.747826] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.747826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.747826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.747826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.747826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.747826] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.747826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.747826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.747826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.747826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.747826] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.747826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.748629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.748629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.748629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.748629] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2245c492-46b0-4c79-a676-4d33727a81b1 is going to be updated. [ 760.772581] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.772581] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.772581] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.773210] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.773369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.773547] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2245c492-46b0-4c79-a676-4d33727a81b1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.048238] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-720 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.048525] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-720" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.048654] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-720" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.049238] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-720" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.051589] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.051589] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.052497] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.052542] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.052662] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.052874] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.053017] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.053133] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.053332] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.053332] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.053444] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.053591] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.055520] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.074579] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.074807] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.074869] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.075021] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-720" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.075347] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-29a69e55-fc00-4cf9-ab87-ac0c8159f685 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.075516] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-29a69e55-fc00-4cf9-ab87-ac0c8159f685" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.075633] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-29a69e55-fc00-4cf9-ab87-ac0c8159f685" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.075942] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-29a69e55-fc00-4cf9-ab87-ac0c8159f685" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.076089] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29a69e55-fc00-4cf9-ab87-ac0c8159f685',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.347842] env[65136]: INFO networking_nsxv3.common.synchronization [req-8a8c6b39-85f1-49ff-9ab2-115a9e56424c req-aab857e9-f1ad-4733-acb2-74fadb7bc943 tempest-ServersNegativeTestMultiTenantJSON-1714821707 tempest-ServersNegativeTestMultiTenantJSON-1714821707-project-member] Enqueued Resource ID: 9f4dd229-f786-4bea-badc-2a0fea17968f with Priority: HIGHEST for action security_group_members [ 761.348789] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4dd229-f786-4bea-badc-2a0fea17968f with Priority: HIGHEST for action security_group_members [ 761.348844] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4dd229-f786-4bea-badc-2a0fea17968f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.349020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.349300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.349643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.349845] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.349995] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.350140] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.350370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.350492] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.350606] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f4dd229-f786-4bea-badc-2a0fea17968f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.558774] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.578673] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.579155] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.579318] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.579619] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.579774] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.579927] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 29a69e55-fc00-4cf9-ab87-ac0c8159f685 not found, creating... [ 761.580204] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.580361] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.580479] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.580692] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.580822] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.581114] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.581265] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.581380] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.581671] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.581802] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.582010] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 29a69e55-fc00-4cf9-ab87-ac0c8159f685 is going to be created. [ 761.616637] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.616798] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.616963] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.617670] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.617670] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.617670] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-29a69e55-fc00-4cf9-ab87-ac0c8159f685" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.741644] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.741855] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-385" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.741985] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-385" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.742361] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-385" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.742646] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.742812] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.742936] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.743162] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.743586] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.743586] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.743758] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.743950] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.744101] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.744245] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.744446] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.744650] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.782679] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.782878] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.783075] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.783313] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-385" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.783764] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-56320033-46db-4200-a5ec-a63b115f351a taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.784092] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-56320033-46db-4200-a5ec-a63b115f351a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.784092] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-56320033-46db-4200-a5ec-a63b115f351a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.784445] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-56320033-46db-4200-a5ec-a63b115f351a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.784695] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56320033-46db-4200-a5ec-a63b115f351a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.852621] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.852828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.852874] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.853095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.853177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.853383] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.853496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.853556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.853736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.853816] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.853935] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f4dd229-f786-4bea-badc-2a0fea17968f already deleted. [ 761.854039] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.065407] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.065407] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.065747] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.065747] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.065968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.065968] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be updated. [ 762.121714] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.122160] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.122635] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.123097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.123422] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.136303] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 in Status: SUCCESS [ 762.136677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.136886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.137190] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.137469] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.137647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.137751] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.137998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.138120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.138224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.138405] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.140401] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 762.289903] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.290243] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.291658] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.291658] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.291658] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.291658] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 56320033-46db-4200-a5ec-a63b115f351a not found, creating... [ 762.291852] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.291929] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.292039] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.292271] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.292448] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.292714] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.292886] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.292971] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.293363] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.293591] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.293793] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 56320033-46db-4200-a5ec-a63b115f351a is going to be created. [ 762.335562] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.335562] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.335887] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.336413] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.337059] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.337059] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-56320033-46db-4200-a5ec-a63b115f351a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.447840] env[65136]: INFO networking_nsxv3.common.synchronization [req-152c4cf1-766e-4751-b614-3e5538faf9e8 req-6e13b9ec-d622-413d-a0ab-8aca23886c01 service nova] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_rules [ 762.448224] env[65136]: INFO networking_nsxv3.common.synchronization [req-152c4cf1-766e-4751-b614-3e5538faf9e8 req-6e13b9ec-d622-413d-a0ab-8aca23886c01 service nova] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 762.448224] env[65136]: INFO networking_nsxv3.common.synchronization [req-152c4cf1-766e-4751-b614-3e5538faf9e8 req-6e13b9ec-d622-413d-a0ab-8aca23886c01 service nova] Enqueued Resource ID: 29a69e55-fc00-4cf9-ab87-ac0c8159f685 with Priority: HIGHEST for action port [ 762.448852] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_rules [ 762.449079] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 762.449175] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a69e55-fc00-4cf9-ab87-ac0c8159f685 with Priority: HIGHEST for action port [ 762.449540] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.449689] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.449892] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.449999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.450204] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-29a69e55-fc00-4cf9-ab87-ac0c8159f685 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.450318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29a69e55-fc00-4cf9-ab87-ac0c8159f685" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.450367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29a69e55-fc00-4cf9-ab87-ac0c8159f685" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.450578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29a69e55-fc00-4cf9-ab87-ac0c8159f685" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.450722] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29a69e55-fc00-4cf9-ab87-ac0c8159f685',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.641651] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.641913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.642037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.642399] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.642647] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.642779] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.642847] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.643140] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.643224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.643332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.643547] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.643657] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.643786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.643964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.644403] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.644551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.644624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.644784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.644893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.644981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.645102] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.692138] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 762.692439] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.953917] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29a69e55-fc00-4cf9-ab87-ac0c8159f685 with status ACTIVE [ 762.954208] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.954354] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.954427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.954686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.954752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.954954] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.955067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.955133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.955290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.955372] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.955567] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.955679] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.955746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.955891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.955968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.956066] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29a69e55-fc00-4cf9-ab87-ac0c8159f685 is going to be updated. [ 762.990881] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.991189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.991394] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.991759] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.992264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.992264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29a69e55-fc00-4cf9-ab87-ac0c8159f685" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.039120] env[65136]: INFO networking_nsxv3.common.synchronization [req-8a8c6b39-85f1-49ff-9ab2-115a9e56424c req-4abacc82-68bb-4b62-b8ed-378af5f07327 service nova] Enqueued Resource ID: 9f4dd229-f786-4bea-badc-2a0fea17968f with Priority: HIGHEST for action security_group_rules [ 763.039120] env[65136]: INFO networking_nsxv3.common.synchronization [req-8a8c6b39-85f1-49ff-9ab2-115a9e56424c req-4abacc82-68bb-4b62-b8ed-378af5f07327 service nova] Enqueued Resource ID: 9f4dd229-f786-4bea-badc-2a0fea17968f with Priority: HIGHEST for action security_group_members [ 763.039120] env[65136]: INFO networking_nsxv3.common.synchronization [req-8a8c6b39-85f1-49ff-9ab2-115a9e56424c req-4abacc82-68bb-4b62-b8ed-378af5f07327 service nova] Enqueued Resource ID: 56320033-46db-4200-a5ec-a63b115f351a with Priority: HIGHEST for action port [ 763.039120] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4dd229-f786-4bea-badc-2a0fea17968f with Priority: HIGHEST for action security_group_rules [ 763.039540] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4dd229-f786-4bea-badc-2a0fea17968f with Priority: HIGHEST for action security_group_members [ 763.039832] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56320033-46db-4200-a5ec-a63b115f351a with Priority: HIGHEST for action port [ 763.040222] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f4dd229-f786-4bea-badc-2a0fea17968f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.040436] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.040546] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.041088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.041355] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f4dd229-f786-4bea-badc-2a0fea17968f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.042598] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4dd229-f786-4bea-badc-2a0fea17968f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.042829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.042882] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.043126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.043328] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.043518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.043571] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.043758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.043894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.044317] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f4dd229-f786-4bea-badc-2a0fea17968f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.047961] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-56320033-46db-4200-a5ec-a63b115f351a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.048341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56320033-46db-4200-a5ec-a63b115f351a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.048341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56320033-46db-4200-a5ec-a63b115f351a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.048660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56320033-46db-4200-a5ec-a63b115f351a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.048996] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56320033-46db-4200-a5ec-a63b115f351a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.148135] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06b0bf22-61b9-4a96-a3f3-ec08a80369b4: rpc.has_security_group_logging(os_id): False [ 763.170467] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.170658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.170725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.170942] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.171064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.171254] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.171373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.171435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.171590] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.171933] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.172252] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.172333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.172365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.172517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.172593] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.172789] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.172883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.172944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.173216] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.173348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.173461] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 is going to be updated. [ 763.249776] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.249939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.250098] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.250321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.250548] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.265351] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 in Status: IN_PROGRESS for 2s [ 763.272871] env[65136]: INFO networking_nsxv3.common.synchronization [req-0ad9949c-07ed-46cb-83a5-6cc23e93178d req-925c27e1-9c46-4cc6-a7b0-be1d863a5cc8 tempest-ServersNegativeTestJSON-605919058 tempest-ServersNegativeTestJSON-605919058-project-member] Enqueued Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_members [ 763.273510] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_members [ 763.274164] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.274164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.274164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.274164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.274353] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.274430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.275126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.275126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.275126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.275126] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.553845] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56320033-46db-4200-a5ec-a63b115f351a with status ACTIVE [ 763.553845] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.553845] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.553845] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.554303] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.554303] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.554497] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.554497] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.554572] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.555899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.555899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.555899] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.555899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.555899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.555899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.555899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.555899] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56320033-46db-4200-a5ec-a63b115f351a is going to be updated. [ 763.557300] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f4dd229-f786-4bea-badc-2a0fea17968f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.558370] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4dd229-f786-4bea-badc-2a0fea17968f taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.558490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.563761] env[65136]: INFO networking_nsxv3.common.synchronization [req-723807d0-d2f4-4eea-a929-750b6771ff59 req-af835ce7-3dfa-405e-b87c-c6ff06fdd5e8 tempest-ListServersNegativeTestJSON-1898468254 tempest-ListServersNegativeTestJSON-1898468254-project-member] Enqueued Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 763.563901] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 763.564591] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.564591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.564745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.564848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.565012] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.565110] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.565172] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.565315] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.565390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.565481] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.578798] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.578968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.579094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.579319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.579484] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.579717] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56320033-46db-4200-a5ec-a63b115f351a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.777717] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.894881] env[65136]: INFO networking_nsxv3.common.synchronization [req-1a77b683-8f85-4cba-91dc-50d1aad70a6d req-1a3cb645-e51f-4ad9-ae23-8b8069de8931 tempest-ListServerFiltersTestJSON-1251039073 tempest-ListServerFiltersTestJSON-1251039073-project-member] Enqueued Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 763.895496] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 763.895883] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.896030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.896112] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.897142] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.897332] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.897438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.897504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.897905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.897905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.897905] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.060864] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f4dd229-f786-4bea-badc-2a0fea17968f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.069419] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.153247] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 764.154320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.155062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.155694] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.155694] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.157108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.157191] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.157384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.157467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.157569] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.285198] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.404564] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.404696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.404763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.404973] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.405073] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.405258] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.405362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.405419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.405537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.405607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.405685] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b already deleted. [ 764.405760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.406772] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-650 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.406932] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-650" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.407069] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-650" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.407351] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-650" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.407594] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.407754] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.408671] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.408671] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.408671] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.408671] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.408671] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 764.408671] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 764.408671] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 764.409095] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 764.409095] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 764.409095] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 764.431835] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 764.431835] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 764.431835] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 764.431835] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-650" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.431835] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-1205c84f-a667-4c55-bc38-a1de8ebddc47 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.431835] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-1205c84f-a667-4c55-bc38-a1de8ebddc47" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.432257] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-1205c84f-a667-4c55-bc38-a1de8ebddc47" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.432470] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-1205c84f-a667-4c55-bc38-a1de8ebddc47" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.432534] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1205c84f-a667-4c55-bc38-a1de8ebddc47',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.565302] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.565302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.565302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.565302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.565302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.565302] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f4dd229-f786-4bea-badc-2a0fea17968f is going to be created. [ 764.571203] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.603663] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.603820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.603889] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.604135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.604357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.614603] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f4dd229-f786-4bea-badc-2a0fea17968f in Status: UNINITIALIZED for 2s [ 764.662837] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.788585] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.788712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.788712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.788933] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.789045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.789168] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b is going to be updated. [ 764.834616] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.834832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.834893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.835206] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.835386] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.847393] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: IN_PROGRESS for 2s [ 764.934997] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.935231] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.935360] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.935662] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.935810] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.935932] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 1205c84f-a667-4c55-bc38-a1de8ebddc47 not found, creating... [ 764.936216] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.936398] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.936608] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.936786] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.936918] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.937214] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.937368] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.937482] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.937682] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.937808] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.937961] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 1205c84f-a667-4c55-bc38-a1de8ebddc47 is going to be created. [ 764.964122] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.964423] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.964619] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.964939] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.965241] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.965518] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-1205c84f-a667-4c55-bc38-a1de8ebddc47" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.073740] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.073879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.073941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.074205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.074277] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.074394] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287b8551-3bf8-4455-afb3-b406697983a1 is going to be updated. [ 765.121914] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.121914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.121914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.121914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.121914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.132494] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: IN_PROGRESS for 2s [ 765.165455] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.421038] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 in Status: SUCCESS [ 765.421038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.670960] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.670960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.670960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.670960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.670960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.670960] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be updated. [ 765.687553] env[65136]: INFO networking_nsxv3.common.synchronization [req-1a77b683-8f85-4cba-91dc-50d1aad70a6d req-914e399b-966d-46c7-bd90-70c44f3ce19f service nova] Enqueued Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_rules [ 765.687553] env[65136]: INFO networking_nsxv3.common.synchronization [req-1a77b683-8f85-4cba-91dc-50d1aad70a6d req-914e399b-966d-46c7-bd90-70c44f3ce19f service nova] Enqueued Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 765.687553] env[65136]: INFO networking_nsxv3.common.synchronization [req-1a77b683-8f85-4cba-91dc-50d1aad70a6d req-914e399b-966d-46c7-bd90-70c44f3ce19f service nova] Enqueued Resource ID: 1205c84f-a667-4c55-bc38-a1de8ebddc47 with Priority: HIGHEST for action port [ 765.688464] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_rules [ 765.688832] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 765.689403] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1205c84f-a667-4c55-bc38-a1de8ebddc47 with Priority: HIGHEST for action port [ 765.689930] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.690409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.690624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.691107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.693051] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.694851] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.695210] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.695425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.695798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.696577] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.697959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.697959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.697959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.697959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.697959] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.700549] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-1205c84f-a667-4c55-bc38-a1de8ebddc47 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.701340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1205c84f-a667-4c55-bc38-a1de8ebddc47" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.701693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1205c84f-a667-4c55-bc38-a1de8ebddc47" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.704026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1205c84f-a667-4c55-bc38-a1de8ebddc47" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.704026] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1205c84f-a667-4c55-bc38-a1de8ebddc47',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.706567] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.707544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.707820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.708411] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.708849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.724182] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 765.960241] env[65136]: INFO networking_nsxv3.common.synchronization [req-21e0dcac-2fa3-4493-b3b0-4635da18be35 req-a46a8e25-b47c-4af5-82e0-c7781efe4b9d tempest-ImagesOneServerNegativeTestJSON-685255343 tempest-ImagesOneServerNegativeTestJSON-685255343-project-member] Enqueued Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 765.960765] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 765.961079] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.961192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.961303] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.961476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.961720] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.961720] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.961820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.962865] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.962865] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.962865] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.197897] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.197897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.201967] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.210118] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1205c84f-a667-4c55-bc38-a1de8ebddc47 with status ACTIVE [ 766.210118] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.210118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.210118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.210118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.210118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.210118] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.210118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.210118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.210118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.210118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.210118] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.210118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.210118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.210118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.210118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.210118] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1205c84f-a667-4c55-bc38-a1de8ebddc47 is going to be updated. [ 766.239182] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.239182] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.239478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.239717] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.239901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.240107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1205c84f-a667-4c55-bc38-a1de8ebddc47" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.466394] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.466394] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.466394] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.466523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.466582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.466849] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.466981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.467060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.467230] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.467317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.467450] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b is going to be updated. [ 766.500518] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.500689] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.500825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.500997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.501301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.513656] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: IN_PROGRESS for 2s [ 766.625664] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f4dd229-f786-4bea-badc-2a0fea17968f in Status: SUCCESS [ 766.625909] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.626118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.626383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.626583] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.626714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.626782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.626941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.627045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.627231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.627231] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f4dd229-f786-4bea-badc-2a0fea17968f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.714337] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.759953] env[65136]: INFO networking_nsxv3.common.synchronization [req-6ea78cd3-93e0-4ced-a8de-c8bf26ce41a1 req-9f3e3acc-6fb9-4296-9bea-5f213e62161c tempest-MultipleCreateTestJSON-1748696551 tempest-MultipleCreateTestJSON-1748696551-project-member] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 766.760511] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 766.760839] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.762478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.762478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.762478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.762478] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.762478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.762684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.762684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.762765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.762882] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.858039] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: SUCCESS [ 766.858276] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.129281] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4dd229-f786-4bea-badc-2a0fea17968f taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.129526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.129526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.130813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.130813] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.130813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.130813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.130813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.130813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.130813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.130813] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4dd229-f786-4bea-badc-2a0fea17968f taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.131371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.131371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.131371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.131371] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.131371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.131371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.131603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.131603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.131603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.131686] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f4dd229-f786-4bea-badc-2a0fea17968f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.143744] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: SUCCESS [ 767.143985] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.200698] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.201023] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.201207] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.201781] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.202212] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.202476] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.202689] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.203087] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.203383] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.203691] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.203923] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.204135] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.204392] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.204572] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.204759] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.205013] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.216917] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.217434] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.218040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.218040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.218040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.218040] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b is going to be created. [ 767.231789] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.232015] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 767.232260] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.232453] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.237217] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-90203b90-8726-4508-9e76-c9ff857d0291 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.238124] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-90203b90-8726-4508-9e76-c9ff857d0291" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.243204] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-90203b90-8726-4508-9e76-c9ff857d0291" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.243204] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-90203b90-8726-4508-9e76-c9ff857d0291" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.243204] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90203b90-8726-4508-9e76-c9ff857d0291',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.254310] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.254424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.254462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.255256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.255742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.265450] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.265613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.265694] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.266173] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.266269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.266483] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.266596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.266654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.266824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.267080] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.267262] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 179594e5-59bd-41ce-8082-1aa739538096 already deleted. [ 767.267359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.268258] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: UNINITIALIZED for 2s [ 767.299906] env[65136]: INFO networking_nsxv3.common.synchronization [req-0b36467a-c991-488a-b125-3406bdce7526 req-3921c3e1-e46e-47e0-bcce-b9e8631a2a05 tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a with Priority: HIGHEST for action security_group_members [ 767.300608] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a with Priority: HIGHEST for action security_group_members [ 767.301016] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.301168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.301228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.301417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.301575] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.301692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.301726] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.302109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.302109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.302109] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b753815-728e-4ba2-a7f0-1eb90d70cc2a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.637514] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f4dd229-f786-4bea-badc-2a0fea17968f: rpc.has_security_group_logging(os_id): False [ 767.660115] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.660295] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.660361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.660617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.660709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.660973] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.661129] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.661211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.661391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.661494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.661717] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.661817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.661882] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.662061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.662147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.662358] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.662493] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.662584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.662792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.662877] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.662975] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f4dd229-f786-4bea-badc-2a0fea17968f is going to be created. [ 767.736613] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 767.736613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.736613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.736613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.736613] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.736613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.736613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.736613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.736613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.736613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.736613] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.736613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.737324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.737324] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.737324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.737324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.737455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.737484] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.737617] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.744729] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.745019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.745019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.745309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.746028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.750848] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.751056] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.752031] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.752031] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.752031] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.752031] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 90203b90-8726-4508-9e76-c9ff857d0291 not found, creating... [ 767.752333] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.752596] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.753035] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.755633] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.755633] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.755633] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.755633] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.755633] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.755633] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.755633] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.755633] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 90203b90-8726-4508-9e76-c9ff857d0291 is going to be created. [ 767.777899] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f4dd229-f786-4bea-badc-2a0fea17968f in Status: IN_PROGRESS for 2s [ 767.783319] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.783541] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.783658] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.783991] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.784189] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.784385] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-90203b90-8726-4508-9e76-c9ff857d0291" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.804964] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.804964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.804964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.805260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.805391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.805659] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.805825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.805923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.806335] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.806423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.806528] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a is going to be updated. [ 767.861462] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.861706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.861859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.862213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.862433] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.892597] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a in Status: IN_PROGRESS for 2s [ 768.239793] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.240147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.240240] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.525951] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: SUCCESS [ 768.526198] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b deletion is rescheduled due to dependency. [ 768.526280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.566727] env[65136]: INFO networking_nsxv3.common.synchronization [req-6ea78cd3-93e0-4ced-a8de-c8bf26ce41a1 req-d5ff23c9-2622-4dfa-9e4b-97fa80af6bda service nova] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_rules [ 768.566788] env[65136]: INFO networking_nsxv3.common.synchronization [req-6ea78cd3-93e0-4ced-a8de-c8bf26ce41a1 req-d5ff23c9-2622-4dfa-9e4b-97fa80af6bda service nova] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 768.566884] env[65136]: INFO networking_nsxv3.common.synchronization [req-6ea78cd3-93e0-4ced-a8de-c8bf26ce41a1 req-d5ff23c9-2622-4dfa-9e4b-97fa80af6bda service nova] Enqueued Resource ID: 90203b90-8726-4508-9e76-c9ff857d0291 with Priority: HIGHEST for action port [ 768.567428] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_rules [ 768.567593] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 768.567707] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90203b90-8726-4508-9e76-c9ff857d0291 with Priority: HIGHEST for action port [ 768.569494] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.571801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.571801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.571801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.571801] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.572842] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.572984] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.573090] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.573387] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.573634] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.573799] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.573888] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.574085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.574185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.574289] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.575319] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-90203b90-8726-4508-9e76-c9ff857d0291 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.575444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90203b90-8726-4508-9e76-c9ff857d0291" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.576321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90203b90-8726-4508-9e76-c9ff857d0291" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.576866] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90203b90-8726-4508-9e76-c9ff857d0291" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.576866] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90203b90-8726-4508-9e76-c9ff857d0291',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.749529] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.079027] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.080220] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.080339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.080602] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90203b90-8726-4508-9e76-c9ff857d0291 with status ACTIVE [ 769.080941] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.081083] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.081083] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.081304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.081494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.081606] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.082181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.082256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.082436] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.082524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.082717] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.082813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.082875] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.083118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.083118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.083204] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90203b90-8726-4508-9e76-c9ff857d0291 is going to be updated. [ 769.114171] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.115302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.116198] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.116198] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.116198] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.116198] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90203b90-8726-4508-9e76-c9ff857d0291" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.256825] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.256825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.256825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.256825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.256825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.256825] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be updated. [ 769.284024] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: SUCCESS [ 769.284024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.284024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.284024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.284024] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.284024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.284024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.284024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.284024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.284024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.284024] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.308803] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.308967] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.309063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.309490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.309578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.322748] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 769.588111] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.788370] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.788749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.788749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.788864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.788982] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.789091] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.789154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.789300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.789385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.789480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.789623] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.789715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.789775] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.789914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.790068] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.790158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.790418] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.790418] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.790418] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.790542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.790754] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.794246] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f4dd229-f786-4bea-badc-2a0fea17968f in Status: SUCCESS [ 769.794450] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.909824] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a in Status: SUCCESS [ 769.909824] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a deletion is rescheduled due to dependency. [ 769.909824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.995419] env[65136]: INFO networking_nsxv3.common.synchronization [req-6ea78cd3-93e0-4ced-a8de-c8bf26ce41a1 req-9cd6a257-1c16-4593-a58d-d46b42441457 tempest-MultipleCreateTestJSON-1748696551 tempest-MultipleCreateTestJSON-1748696551-project-member] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 769.996665] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 769.996665] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.996665] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.091958] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.092078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.092138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.092432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.092546] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.092668] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be created. [ 770.118941] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.119094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.119166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.119404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.119775] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.131930] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: UNINITIALIZED for 2s [ 770.293990] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b: rpc.has_security_group_logging(os_id): False [ 770.318205] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.319012] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.319173] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.319467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.319592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.319949] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.320060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.320060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.320268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.320382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.320641] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.320758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.320820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.321695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.321801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.321976] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.322092] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.322155] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.322312] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.322427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.322763] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b is going to be created. [ 770.367114] env[65136]: INFO networking_nsxv3.common.synchronization [req-2b237cff-9685-4fe4-b3c9-8ad7a32356d7 req-a70047d0-ee6a-4159-a1ef-b39cc8ec3bb1 tempest-ServerActionsV293TestJSON-1327897741 tempest-ServerActionsV293TestJSON-1327897741-project-member] Enqueued Resource ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a with Priority: HIGHEST for action security_group_members [ 770.367757] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a with Priority: HIGHEST for action security_group_members [ 770.369750] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-837b8c63-6d80-45d3-a9be-427d83c5b42a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.369750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.369750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.369750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.369750] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.369750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.369750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.369750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.369750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.370247] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('837b8c63-6d80-45d3-a9be-427d83c5b42a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.397820] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.397820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.397820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.398047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.398139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.414379] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: IN_PROGRESS for 2s [ 770.872756] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.873041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.873041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.873250] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.873355] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.873574] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.873683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.873761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.874023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.874107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.874198] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a is going to be updated. [ 770.903439] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.903625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.903708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.904050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.904050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.917347] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a in Status: IN_PROGRESS for 2s [ 771.191851] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.192032] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.192096] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.192388] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.192691] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.193204] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.193204] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.193280] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.193385] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.193626] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.193809] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.194246] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.194309] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.194393] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.194529] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.194667] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.216893] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.217078] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 771.217285] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.217522] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.218037] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-da7cf158-c0d8-4255-9ede-1fbd00f87c52 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.218183] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-da7cf158-c0d8-4255-9ede-1fbd00f87c52" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.218305] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-da7cf158-c0d8-4255-9ede-1fbd00f87c52" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.218687] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-da7cf158-c0d8-4255-9ede-1fbd00f87c52" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.218893] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da7cf158-c0d8-4255-9ede-1fbd00f87c52',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.337643] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 771.338298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.338353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.340715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.340715] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.340715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.340715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.340715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.340715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.340715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.341151] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.341373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.341500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.341897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.342118] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.342421] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.342602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.342887] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.343095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.343265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.343446] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.726493] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.726493] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.726493] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.726709] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.726870] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.727076] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port da7cf158-c0d8-4255-9ede-1fbd00f87c52 not found, creating... [ 771.727720] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.728163] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.728749] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.729107] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.729107] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.729373] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.729521] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.729674] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.729789] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.729927] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.730874] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: da7cf158-c0d8-4255-9ede-1fbd00f87c52 is going to be created. [ 771.757316] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.757653] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.757829] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.758217] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.758501] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.758761] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-da7cf158-c0d8-4255-9ede-1fbd00f87c52" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.849029] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7767bb26-265a-4c1f-9c68-9bd50a08bacb: rpc.has_security_group_logging(os_id): False [ 771.878043] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.878385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.878385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.878645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.878748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.878975] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.879111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.879175] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.879333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.879409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.879593] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.879687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.880170] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.882795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.882795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.882795] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.882795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.882795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.882795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.882795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.882795] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be updated. [ 771.963259] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.963516] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.963638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.963976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.964251] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.982155] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 772.149244] env[65136]: INFO networking_nsxv3.common.synchronization [None req-d6dc86dc-c307-4de4-a51d-7de237755605 None None] Enqueued Resource ID: 835cabba-52ec-4248-ad6a-5365ed1bc23f with Priority: HIGHEST for action port [ 772.152209] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 835cabba-52ec-4248-ad6a-5365ed1bc23f with Priority: HIGHEST for action port [ 772.152209] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-835cabba-52ec-4248-ad6a-5365ed1bc23f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.152209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-835cabba-52ec-4248-ad6a-5365ed1bc23f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.152209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-835cabba-52ec-4248-ad6a-5365ed1bc23f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.152209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-835cabba-52ec-4248-ad6a-5365ed1bc23f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.152209] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('835cabba-52ec-4248-ad6a-5365ed1bc23f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.172029] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: SUCCESS [ 772.172029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.172029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.172029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.172029] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.172029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.172029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.172029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.172029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.172029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.172029] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.173815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.174186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.175209] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.176117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.176502] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.176795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.177011] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.177209] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.432482] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: SUCCESS [ 772.432734] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.559931] env[65136]: INFO networking_nsxv3.common.synchronization [req-6ea78cd3-93e0-4ced-a8de-c8bf26ce41a1 req-50430dfb-5dfc-4a74-9d0b-171f078d7005 service nova] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_rules [ 772.560121] env[65136]: INFO networking_nsxv3.common.synchronization [req-6ea78cd3-93e0-4ced-a8de-c8bf26ce41a1 req-50430dfb-5dfc-4a74-9d0b-171f078d7005 service nova] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 772.560672] env[65136]: INFO networking_nsxv3.common.synchronization [req-6ea78cd3-93e0-4ced-a8de-c8bf26ce41a1 req-50430dfb-5dfc-4a74-9d0b-171f078d7005 service nova] Enqueued Resource ID: da7cf158-c0d8-4255-9ede-1fbd00f87c52 with Priority: HIGHEST for action port [ 772.560903] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_rules [ 772.563080] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 772.563300] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da7cf158-c0d8-4255-9ede-1fbd00f87c52 with Priority: HIGHEST for action port [ 772.563527] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.563632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.564252] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.564323] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.564678] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-da7cf158-c0d8-4255-9ede-1fbd00f87c52 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.564678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da7cf158-c0d8-4255-9ede-1fbd00f87c52" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.564678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da7cf158-c0d8-4255-9ede-1fbd00f87c52" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.565071] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da7cf158-c0d8-4255-9ede-1fbd00f87c52" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.565071] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da7cf158-c0d8-4255-9ede-1fbd00f87c52',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.654923] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 835cabba-52ec-4248-ad6a-5365ed1bc23f [ 772.656453] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.656453] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.656453] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.656453] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.656453] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.656453] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:835cabba-52ec-4248-ad6a-5365ed1bc23f already deleted. [ 772.656453] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-835cabba-52ec-4248-ad6a-5365ed1bc23f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.679795] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.680150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.680405] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.859262] env[65136]: INFO networking_nsxv3.common.synchronization [req-39f2140e-648d-483b-ac7f-be96894fd44b req-e5906f5b-b21b-4708-9e5b-db831f7441ca tempest-DeleteServersTestJSON-1045367082 tempest-DeleteServersTestJSON-1045367082-project-member] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 772.860107] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 772.860682] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.860861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.860861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.861109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.861329] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.861476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.861600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.861776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.861895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.862044] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.929106] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a in Status: SUCCESS [ 772.929423] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a deletion is rescheduled due to dependency. [ 772.929423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.071410] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da7cf158-c0d8-4255-9ede-1fbd00f87c52 with status ACTIVE [ 773.071787] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.071999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.072174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.072489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.072708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.072968] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.073345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.073345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.073512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.073569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.073828] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.073986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.074117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.074331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.074454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.074564] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da7cf158-c0d8-4255-9ede-1fbd00f87c52 is going to be updated. [ 773.104686] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.104831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.104901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.105132] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.105264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.105475] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da7cf158-c0d8-4255-9ede-1fbd00f87c52" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.182679] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.367729] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.476180] env[65136]: INFO networking_nsxv3.common.synchronization [req-ad0e07d9-8681-40ae-9a62-7fc7a048acdc req-7de275f1-3800-4046-9934-0f5a38245f36 tempest-ServersWithSpecificFlavorTestJSON-92176410 tempest-ServersWithSpecificFlavorTestJSON-92176410-project-member] Enqueued Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_members [ 773.476180] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_members [ 773.476180] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.476180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.476180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.476180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.476180] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.477154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.477356] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.477646] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.477853] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.478275] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.687119] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.687427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.687515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.687810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.687914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.688033] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be updated. [ 773.723028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.723028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.723028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.723028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.723028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.731877] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: IN_PROGRESS for 2s [ 773.872141] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.983345] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.983735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.983735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.983811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.984256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.984256] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.984256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.984256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.984484] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.984484] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.984542] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 is going to be updated. [ 774.003891] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 774.004189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.004491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.004711] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.004823] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.025968] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.026228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.026348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.026726] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.027034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.040100] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: IN_PROGRESS for 2s [ 774.375030] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.375030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.375030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.375030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.375030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.375030] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 774.406814] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.406950] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.407041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.407258] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.407404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.426854] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 774.509209] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.509209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.509209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.509209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.509209] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.509209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.509209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.509209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.509209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.509209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.509209] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.587501] env[65136]: INFO networking_nsxv3.common.synchronization [None req-68cb9bcd-a51a-4bca-aa75-311bf1cef6c3 None None] Enqueued Resource ID: 9dc9dd58-a23e-441c-8736-591d8dd50124 with Priority: HIGHEST for action port [ 774.588915] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dc9dd58-a23e-441c-8736-591d8dd50124 with Priority: HIGHEST for action port [ 774.589221] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dc9dd58-a23e-441c-8736-591d8dd50124 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.591478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dc9dd58-a23e-441c-8736-591d8dd50124" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.591560] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dc9dd58-a23e-441c-8736-591d8dd50124" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.591843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dc9dd58-a23e-441c-8736-591d8dd50124" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.591919] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dc9dd58-a23e-441c-8736-591d8dd50124',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.903849] env[65136]: INFO networking_nsxv3.common.synchronization [req-ca66ebcc-81bf-4b89-894e-fddd0ad5f10a req-ac3f29de-35f3-4cbe-9a08-b9934a5bff20 tempest-ListServerFiltersTestJSON-1251039073 tempest-ListServerFiltersTestJSON-1251039073-project-member] Enqueued Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 774.905790] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 774.906201] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.906382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.906472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.906684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.906908] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.907073] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.907125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.907254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.907343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.907441] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.015228] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.015228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.015228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.015228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.015228] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.015228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.015228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.015228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.015228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.015228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.015228] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.015228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.015228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.015228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.015228] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.015228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.016211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.016558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.016758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.016936] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.017136] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.095739] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9dc9dd58-a23e-441c-8736-591d8dd50124 [ 775.095739] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.095739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.095739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.095739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.095739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.095739] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9dc9dd58-a23e-441c-8736-591d8dd50124 already deleted. [ 775.095739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dc9dd58-a23e-441c-8736-591d8dd50124" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.410268] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.519883] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7767bb26-265a-4c1f-9c68-9bd50a08bacb: rpc.has_security_group_logging(os_id): False [ 775.540092] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.540353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.540470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.540619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.540730] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.540966] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.541137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.541405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.541517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.541587] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.541778] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.541938] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.541984] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.542507] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.542625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.542863] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.543025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.543078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.543253] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.543343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.543438] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be updated. [ 775.621769] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.621933] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.621977] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.622211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.622444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.637960] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 775.670793] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-650 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.671072] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-650" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.671193] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-650" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.671576] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-650" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.671895] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.672088] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.672211] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.672729] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.672729] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.672875] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.672982] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.673107] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.673223] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.673310] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.673428] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.673578] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.696680] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.696837] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 775.696993] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.697250] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-650" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.697687] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-51ab48df-d982-4508-9737-6a85c7cf2f67 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.697883] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-51ab48df-d982-4508-9737-6a85c7cf2f67" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.698125] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-51ab48df-d982-4508-9737-6a85c7cf2f67" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.698554] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-51ab48df-d982-4508-9737-6a85c7cf2f67" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.698749] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51ab48df-d982-4508-9737-6a85c7cf2f67',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.746186] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: SUCCESS [ 775.746617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.746822] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.747103] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.747336] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.747576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.747702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.747882] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.747989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.748162] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.913094] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.050953] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: SUCCESS [ 776.051254] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 deletion is rescheduled due to dependency. [ 776.051302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.202563] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.203151] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.203379] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.203776] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.203985] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.204323] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 51ab48df-d982-4508-9737-6a85c7cf2f67 not found, creating... [ 776.204754] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.204947] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.205173] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.205474] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.205697] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.206137] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.206302] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.206604] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.206966] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.207133] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.207306] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 51ab48df-d982-4508-9737-6a85c7cf2f67 is going to be created. [ 776.232876] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.233625] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.234631] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.234946] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.235207] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.235470] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-51ab48df-d982-4508-9737-6a85c7cf2f67" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.254128] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.275964] env[65136]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 776.276173] env[65136]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] NSXv3 Agent Agent loop - iteration:1 started [ 776.417479] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.417479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.417479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.417479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.417479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.417479] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b is going to be updated. [ 776.441230] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 776.441693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.458067] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.458067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.458067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.458067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.458067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.466252] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: IN_PROGRESS for 2s [ 776.756755] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.961756] env[65136]: INFO networking_nsxv3.common.synchronization [req-ca66ebcc-81bf-4b89-894e-fddd0ad5f10a req-832735d8-2068-414f-ad3e-996819c97e32 service nova] Enqueued Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_rules [ 776.961933] env[65136]: INFO networking_nsxv3.common.synchronization [req-ca66ebcc-81bf-4b89-894e-fddd0ad5f10a req-832735d8-2068-414f-ad3e-996819c97e32 service nova] Enqueued Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 776.962081] env[65136]: INFO networking_nsxv3.common.synchronization [req-ca66ebcc-81bf-4b89-894e-fddd0ad5f10a req-832735d8-2068-414f-ad3e-996819c97e32 service nova] Enqueued Resource ID: 51ab48df-d982-4508-9737-6a85c7cf2f67 with Priority: HIGHEST for action port [ 776.962804] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_rules [ 776.962942] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 776.963060] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51ab48df-d982-4508-9737-6a85c7cf2f67 with Priority: HIGHEST for action port [ 776.963650] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.963808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.963881] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.964129] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.964245] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.965115] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.965215] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.965411] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-51ab48df-d982-4508-9737-6a85c7cf2f67 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.965531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51ab48df-d982-4508-9737-6a85c7cf2f67" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.965599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51ab48df-d982-4508-9737-6a85c7cf2f67" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.965774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51ab48df-d982-4508-9737-6a85c7cf2f67" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.965848] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51ab48df-d982-4508-9737-6a85c7cf2f67',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.261696] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.261696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.261696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.261696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.261696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.261696] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be updated. [ 777.316480] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.316480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.316768] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.316828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.317326] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.329034] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: IN_PROGRESS for 2s [ 777.468451] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.468620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.470611] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51ab48df-d982-4508-9737-6a85c7cf2f67 with status ACTIVE [ 777.472367] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.472505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.472579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.472797] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.472890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.473085] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.473188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.473253] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.473422] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.473505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.473726] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.473809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.473844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.473998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.474050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.474141] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51ab48df-d982-4508-9737-6a85c7cf2f67 is going to be updated. [ 777.500654] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.500845] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.500924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.501260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.501385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.501591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51ab48df-d982-4508-9737-6a85c7cf2f67" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.602049] env[65136]: INFO networking_nsxv3.common.synchronization [None req-9f215317-1659-4b6b-b82a-4f3827920739 None None] Enqueued Resource ID: 601fe89d-bd17-485d-b6a4-cae779220e13 with Priority: HIGHEST for action port [ 777.602654] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 601fe89d-bd17-485d-b6a4-cae779220e13 with Priority: HIGHEST for action port [ 777.603414] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-601fe89d-bd17-485d-b6a4-cae779220e13 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.603864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-601fe89d-bd17-485d-b6a4-cae779220e13" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.604729] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-601fe89d-bd17-485d-b6a4-cae779220e13" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.605147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-601fe89d-bd17-485d-b6a4-cae779220e13" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.605212] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('601fe89d-bd17-485d-b6a4-cae779220e13',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.660983] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 777.661223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.108468] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 601fe89d-bd17-485d-b6a4-cae779220e13 [ 778.108767] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.108955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.109046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.109276] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.109491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.109491] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:601fe89d-bd17-485d-b6a4-cae779220e13 already deleted. [ 778.109630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-601fe89d-bd17-485d-b6a4-cae779220e13" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.477992] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: SUCCESS [ 778.478340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.478483] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.478683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.478847] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.478982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.479060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.479201] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.479293] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.479421] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.984563] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.347033] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: SUCCESS [ 779.347033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.347033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.347033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.347033] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.347033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.347033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.347033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.347033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.347033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.347033] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.347033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.347033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.347033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.347033] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.347033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.347033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.347033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.347033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.348544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.348544] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.488041] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.851167] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 179594e5-59bd-41ce-8082-1aa739538096: rpc.has_security_group_logging(os_id): False [ 779.873371] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.874227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.874424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.875303] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.875625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.875969] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.876423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.876522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.876837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.877113] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.877937] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.878124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.878334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.878504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.878644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.878968] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.879154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.879275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.879519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.879651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.879809] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be created. [ 779.982492] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.982735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.982814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.984635] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.984758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.990433] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.990702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.991528] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.991854] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.991942] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.992100] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b is going to be updated. [ 780.000167] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: IN_PROGRESS for 2s [ 780.046751] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.047209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.047209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.047296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.048033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.068548] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: IN_PROGRESS for 2s [ 780.235993] env[65136]: INFO networking_nsxv3.common.synchronization [None req-db3cb8ab-62ee-4772-8a32-64f6132efc17 None None] Enqueued Resource ID: 50f4f2fa-a5a2-4444-8a6a-a6e50e79d134 with Priority: HIGHEST for action port [ 780.236330] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50f4f2fa-a5a2-4444-8a6a-a6e50e79d134 with Priority: HIGHEST for action port [ 780.236977] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-50f4f2fa-a5a2-4444-8a6a-a6e50e79d134 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.236977] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50f4f2fa-a5a2-4444-8a6a-a6e50e79d134" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.236977] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50f4f2fa-a5a2-4444-8a6a-a6e50e79d134" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.237719] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50f4f2fa-a5a2-4444-8a6a-a6e50e79d134" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.237719] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50f4f2fa-a5a2-4444-8a6a-a6e50e79d134',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.741971] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50f4f2fa-a5a2-4444-8a6a-a6e50e79d134 [ 780.742587] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.742899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.743047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.743201] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.743335] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.743432] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50f4f2fa-a5a2-4444-8a6a-a6e50e79d134 already deleted. [ 780.743515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50f4f2fa-a5a2-4444-8a6a-a6e50e79d134" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.084663] env[65136]: INFO networking_nsxv3.common.synchronization [req-3abd8732-4a8e-4e6b-ad8e-ca54cdfda26b req-8e7e32f0-76f2-4363-9ed4-e83795f2c5cd tempest-FloatingIPsAssociationNegativeTestJSON-2039364408 tempest-FloatingIPsAssociationNegativeTestJSON-2039364408-project-member] Enqueued Resource ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 with Priority: HIGHEST for action security_group_members [ 781.087029] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 with Priority: HIGHEST for action security_group_members [ 781.087029] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.088141] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.088364] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.090837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.090837] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.090837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.090837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.090837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.090837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.090837] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.592680] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.592866] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.592925] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.593808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.593917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.594160] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.594273] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.594336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.594505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.594585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.594673] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 is going to be updated. [ 781.627972] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.628160] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.628200] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.628449] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.628610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.640412] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 in Status: IN_PROGRESS for 2s [ 781.875287] env[65136]: INFO networking_nsxv3.common.synchronization [None req-80548615-5396-4c58-b045-390cc5baa352 None None] Enqueued Resource ID: 20a159f0-ea2c-42e8-ac12-91ea9311b4a3 with Priority: HIGHEST for action port [ 781.876046] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20a159f0-ea2c-42e8-ac12-91ea9311b4a3 with Priority: HIGHEST for action port [ 781.876423] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-20a159f0-ea2c-42e8-ac12-91ea9311b4a3 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.876565] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20a159f0-ea2c-42e8-ac12-91ea9311b4a3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.876668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20a159f0-ea2c-42e8-ac12-91ea9311b4a3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.876963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20a159f0-ea2c-42e8-ac12-91ea9311b4a3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.877692] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20a159f0-ea2c-42e8-ac12-91ea9311b4a3',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.938244] env[65136]: INFO networking_nsxv3.common.synchronization [req-212ef5d0-b4b5-48ba-a436-a6d07e96cd56 req-88fd3cb0-d48b-40c5-b5d5-0204c9d80ad4 tempest-ServerDiskConfigTestJSON-1818502390 tempest-ServerDiskConfigTestJSON-1818502390-project-member] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 781.938811] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 781.939122] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.939426] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.939426] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.939537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.939785] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.939785] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.939785] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.939954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.940008] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.940240] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.012566] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: SUCCESS [ 782.012801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.012977] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.013447] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.013547] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.082683] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: SUCCESS [ 782.086467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.086467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.086467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.086467] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.086467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.086467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.086467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.086467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.086467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.086467] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.380141] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20a159f0-ea2c-42e8-ac12-91ea9311b4a3 [ 782.380371] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.380503] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.380568] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.380791] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.380877] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.380962] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20a159f0-ea2c-42e8-ac12-91ea9311b4a3 already deleted. [ 782.381060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20a159f0-ea2c-42e8-ac12-91ea9311b4a3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.395962] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.396135] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.396237] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.396576] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.396839] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.396982] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.397113] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.397791] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.398024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.398260] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.398611] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.398611] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.398611] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.398780] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.398780] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.402079] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.423637] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.423637] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 782.423637] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.423637] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.423637] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-078ecff4-7b17-4a4b-bb46-102a8852162c taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.423637] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-078ecff4-7b17-4a4b-bb46-102a8852162c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.423637] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-078ecff4-7b17-4a4b-bb46-102a8852162c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.423637] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-078ecff4-7b17-4a4b-bb46-102a8852162c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.423637] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('078ecff4-7b17-4a4b-bb46-102a8852162c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.442914] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.446023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.446023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.446023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.446023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.446023] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.446023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.446023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.446023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.446023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.446023] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be updated. [ 782.485171] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.485395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.485652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.486404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.486604] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.502172] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 782.516874] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.517245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.517245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.517522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.517732] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.517863] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.517979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.518212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.518338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.518505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.518646] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.544050] env[65136]: INFO networking_nsxv3.common.synchronization [None req-81f69f08-959f-4c2f-a64c-d4ab0dfd8125 None None] Enqueued Resource ID: 59b8c80d-5e6e-45e1-afe4-e1113593a453 with Priority: HIGHEST for action port [ 782.544587] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b8c80d-5e6e-45e1-afe4-e1113593a453 with Priority: HIGHEST for action port [ 782.544904] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-59b8c80d-5e6e-45e1-afe4-e1113593a453 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.547943] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59b8c80d-5e6e-45e1-afe4-e1113593a453" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.548073] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59b8c80d-5e6e-45e1-afe4-e1113593a453" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.548345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59b8c80d-5e6e-45e1-afe4-e1113593a453" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.548456] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59b8c80d-5e6e-45e1-afe4-e1113593a453',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.588870] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.589117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.589117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.589379] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.589532] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.589615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.589669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.589876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.589876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.590040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.590112] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.590203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.590267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.590442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.590591] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.591057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.591057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.591057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.591057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.591057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.591259] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.928334] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.928713] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.928713] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.929019] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.929205] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.929609] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 078ecff4-7b17-4a4b-bb46-102a8852162c not found, creating... [ 782.929930] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.930126] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.930264] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.930529] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.930668] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.931724] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.931924] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.932058] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.932286] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.932418] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.932559] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 078ecff4-7b17-4a4b-bb46-102a8852162c is going to be created. [ 782.954940] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.955281] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.955380] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.955740] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.955851] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.955989] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-078ecff4-7b17-4a4b-bb46-102a8852162c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.021632] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.021843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.021911] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.022184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.022327] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.022422] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.022478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.022709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.022867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.022930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.023044] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.023133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.023197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.023379] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.023521] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.023624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.024235] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.024345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.024454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.024511] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.024615] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.053019] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59b8c80d-5e6e-45e1-afe4-e1113593a453 [ 783.053019] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.053019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.053019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.053019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.053019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.053019] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59b8c80d-5e6e-45e1-afe4-e1113593a453 already deleted. [ 783.053019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59b8c80d-5e6e-45e1-afe4-e1113593a453" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.098242] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b: rpc.has_security_group_logging(os_id): False [ 783.118020] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.118020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.118020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.118020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.118020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.118020] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.118020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.118020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.118020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.118020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.121190] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.121504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.121569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.122226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.122226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.122226] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.122412] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.122472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.122701] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.122802] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.123084] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b is going to be updated. [ 783.190664] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.190836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.191363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.192179] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.194139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.210581] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: IN_PROGRESS for 2s [ 783.527273] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 179594e5-59bd-41ce-8082-1aa739538096: rpc.has_security_group_logging(os_id): False [ 783.553059] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.553059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.553059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.553059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.553059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.553059] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.553059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.553059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.553059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.553059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.553708] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.553708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.553708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.553708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.553708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.553708] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.554051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.554051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.554051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.554051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.554191] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be updated. [ 783.626156] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.626156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.626156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.626156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.626156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.639925] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: IN_PROGRESS for 2s [ 783.651156] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 in Status: SUCCESS [ 783.651358] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5 deletion is rescheduled due to dependency. [ 783.651490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.707416] env[65136]: INFO networking_nsxv3.common.synchronization [req-212ef5d0-b4b5-48ba-a436-a6d07e96cd56 req-6fe7eb91-0817-4e5b-896e-35736dc5d376 service nova] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_rules [ 783.707666] env[65136]: INFO networking_nsxv3.common.synchronization [req-212ef5d0-b4b5-48ba-a436-a6d07e96cd56 req-6fe7eb91-0817-4e5b-896e-35736dc5d376 service nova] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 783.707947] env[65136]: INFO networking_nsxv3.common.synchronization [req-212ef5d0-b4b5-48ba-a436-a6d07e96cd56 req-6fe7eb91-0817-4e5b-896e-35736dc5d376 service nova] Enqueued Resource ID: 078ecff4-7b17-4a4b-bb46-102a8852162c with Priority: HIGHEST for action port [ 783.708708] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_rules [ 783.708850] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 783.708947] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 078ecff4-7b17-4a4b-bb46-102a8852162c with Priority: HIGHEST for action port [ 783.709313] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.709620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.709774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.709979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.710084] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.711991] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.711991] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.711991] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-078ecff4-7b17-4a4b-bb46-102a8852162c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.711991] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-078ecff4-7b17-4a4b-bb46-102a8852162c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.711991] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-078ecff4-7b17-4a4b-bb46-102a8852162c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.711991] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-078ecff4-7b17-4a4b-bb46-102a8852162c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.711991] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('078ecff4-7b17-4a4b-bb46-102a8852162c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.213940] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.214922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.215213] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 078ecff4-7b17-4a4b-bb46-102a8852162c with status ACTIVE [ 784.215397] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.215505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.215552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.215776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.215849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.216098] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.216202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.216202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.216409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.216409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.216698] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.216698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.217403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.217403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.217403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.217403] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 078ecff4-7b17-4a4b-bb46-102a8852162c is going to be updated. [ 784.254802] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.255037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.255445] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.255445] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.255644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.256088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-078ecff4-7b17-4a4b-bb46-102a8852162c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.517075] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 784.517075] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d deletion is rescheduled due to dependency. [ 784.517075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.517075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.517075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.517075] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.517075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.517075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.517075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.517075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.517075] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.020123] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.225497] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: SUCCESS [ 785.225884] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.522533] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.656665] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: SUCCESS [ 785.656665] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.687721] env[65136]: INFO networking_nsxv3.common.synchronization [req-a5aa29b4-cc42-40b8-b827-0ab9b563ab92 req-436f043f-1bf8-4f1b-81e7-fc72e98c8cd8 tempest-ServersTestMultiNic-1831982173 tempest-ServersTestMultiNic-1831982173-project-member] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 785.690615] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 785.691269] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.691349] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.691432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.691675] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.691882] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.691973] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.692026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.692188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.692288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.692385] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.024653] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.024799] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.024873] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.025163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.025212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.025308] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be updated. [ 786.028045] env[65136]: INFO networking_nsxv3.common.synchronization [req-a5aa29b4-cc42-40b8-b827-0ab9b563ab92 req-01c553ee-4428-42b6-8129-1fe59288d23d tempest-ServersTestMultiNic-1831982173 tempest-ServersTestMultiNic-1831982173-project-member] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 786.028458] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGHEST for action security_group_members [ 786.029224] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.029361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.036132] env[65136]: INFO networking_nsxv3.common.synchronization [req-44a750df-deca-4aff-bcc9-4d9ecd8ff476 req-c92c7c0f-becd-4edc-ac8f-53ae2e8d98a4 tempest-ListServerFiltersTestJSON-1251039073 tempest-ListServerFiltersTestJSON-1251039073-project-member] Enqueued Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 786.036603] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 786.036810] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.036929] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.037016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.037842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.038220] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.038220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.038220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.038378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.038461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.038545] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.067339] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.067339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.067339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.067339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.067339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.075891] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 786.195603] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.479791] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-650 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.480137] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-650" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.480137] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-650" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.480379] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-650" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.480865] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.480865] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.481050] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.481169] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.481303] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.481544] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.481655] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.481867] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.482011] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.482199] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.482272] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.482358] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.501221] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.501221] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 786.501221] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.501415] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-650" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.501693] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.501857] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.502051] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.502423] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.502611] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.541400] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.698298] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.004920] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.006039] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.006039] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.006039] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.006039] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.006039] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18 not found, creating... [ 787.006267] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.006390] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.006489] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.006650] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.006779] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.007128] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.007286] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.007396] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.007616] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.007844] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.008476] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18 is going to be created. [ 787.028183] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.028374] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.028533] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.028846] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.029134] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.029371] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.044029] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.201207] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.201634] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.201634] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.201754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.201754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.202752] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be updated. [ 787.240429] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.240664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.240664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.240843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.240997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.250428] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 787.546625] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.546940] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.546940] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.547077] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.547172] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.547306] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b is going to be updated. [ 787.576992] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.577142] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.577217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.578108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.578284] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.587954] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: IN_PROGRESS for 2s [ 787.740275] env[65136]: INFO networking_nsxv3.common.synchronization [req-44a750df-deca-4aff-bcc9-4d9ecd8ff476 req-ff702e5f-108e-411e-a7a4-72ddb41b8491 service nova] Enqueued Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_rules [ 787.740440] env[65136]: INFO networking_nsxv3.common.synchronization [req-44a750df-deca-4aff-bcc9-4d9ecd8ff476 req-ff702e5f-108e-411e-a7a4-72ddb41b8491 service nova] Enqueued Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 787.740575] env[65136]: INFO networking_nsxv3.common.synchronization [req-44a750df-deca-4aff-bcc9-4d9ecd8ff476 req-ff702e5f-108e-411e-a7a4-72ddb41b8491 service nova] Enqueued Resource ID: 71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18 with Priority: HIGHEST for action port [ 787.741116] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_rules [ 787.741242] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 787.741339] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18 with Priority: HIGHEST for action port [ 787.741607] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.741728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.741793] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.741993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.745687] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.746867] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.746973] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.747188] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.747293] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.747360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.747586] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.747870] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.090222] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 788.090222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.090222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.090222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.090222] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.090222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.090222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.090222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.090222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.090222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.090222] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.251180] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.251317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.251548] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18 with status ACTIVE [ 788.251755] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.251880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.251946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.252239] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.252340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.252571] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.252857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.252938] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.253133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.253610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.253610] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.253729] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.253729] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.253948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.254129] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.254297] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18 is going to be updated. [ 788.279143] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.279385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.279385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.279920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.280112] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.280311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71bfe8a6-a0a7-4ce4-a8c8-a0ec47022a18" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.593811] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.594241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.594241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.594344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.594659] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.594659] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.594659] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.594900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.594900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.594989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.595935] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.595935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.595935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.595935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.595935] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.595935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.595935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.595935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.595935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.595935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.596504] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.098662] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605661ba-c8c2-4dae-8382-f55a5d1ead5d: rpc.has_security_group_logging(os_id): False [ 789.120219] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.120423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.120423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.120615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.120708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.120912] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.121067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.121067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.121220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.121295] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.121675] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.121675] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.121859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.121859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.121968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.122170] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.122170] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.122333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.123903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.123981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.124096] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be updated. [ 789.136121] env[65136]: INFO networking_nsxv3.common.synchronization [None req-bd935f71-60b1-427d-8765-8dc52f3ef23f None None] Enqueued Resource ID: f9ee67c2-02be-4d58-bb1e-347ff1127fed with Priority: HIGHEST for action port [ 789.136702] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ee67c2-02be-4d58-bb1e-347ff1127fed with Priority: HIGHEST for action port [ 789.136954] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9ee67c2-02be-4d58-bb1e-347ff1127fed taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.137106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9ee67c2-02be-4d58-bb1e-347ff1127fed" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.137515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9ee67c2-02be-4d58-bb1e-347ff1127fed" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.137515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9ee67c2-02be-4d58-bb1e-347ff1127fed" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.137515] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9ee67c2-02be-4d58-bb1e-347ff1127fed',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.195712] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.195712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.195712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.195712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.196031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.211390] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 789.269233] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 789.269507] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.269728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.269989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.270240] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.270387] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.270473] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.270716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.270821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.270963] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.604053] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: SUCCESS [ 789.604541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.604541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.604764] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.604891] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.604959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.605019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.605220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.605281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.605399] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.639780] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9ee67c2-02be-4d58-bb1e-347ff1127fed [ 789.639997] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.640218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.640329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.640643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.640811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.641206] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9ee67c2-02be-4d58-bb1e-347ff1127fed already deleted. [ 789.641300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9ee67c2-02be-4d58-bb1e-347ff1127fed" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.731609] env[65136]: INFO networking_nsxv3.common.synchronization [req-46d40057-2ab5-4f28-b15e-302ecd6bd925 req-21510f5a-b7a3-4c7c-89ec-928d8562ccb2 tempest-MultipleCreateTestJSON-1748696551 tempest-MultipleCreateTestJSON-1748696551-project-member] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 789.731879] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 789.732215] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.732335] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.732406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.732606] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.732778] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.732868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.732922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.733101] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.733174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.733267] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.775259] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.775259] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.775259] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.775259] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.775259] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.775259] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.775259] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.775259] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.775939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.776147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.777070] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be updated. [ 789.815274] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.815510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.815510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.815811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.816070] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.829919] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: IN_PROGRESS for 2s [ 790.112538] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.237425] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.428624] env[65136]: INFO networking_nsxv3.common.synchronization [req-eb75fc4b-449b-4651-82f7-95bcc620a12f req-54403d12-3bf1-47f7-a511-c5d0f9658c5a tempest-ImagesTestJSON-1051903205 tempest-ImagesTestJSON-1051903205-project-member] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 790.429225] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 790.430401] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.430401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.430401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.430401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.430401] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.430401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.430401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.430765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.430765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.430765] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.613990] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.743394] env[65136]: INFO networking_nsxv3.common.synchronization [req-4d4da06f-1ff4-415f-80d0-7b705eb0c28c req-f50758bb-e140-480e-bd1b-77de51f62556 tempest-MultipleCreateTestJSON-1748696551 tempest-MultipleCreateTestJSON-1748696551-project-member] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 790.744014] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 790.744292] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.748834] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.748997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.933963] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.933963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.934094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.934405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.934500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.934735] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.935472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.935525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.935815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.935941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.936301] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 790.963157] env[65136]: INFO networking_nsxv3.common.synchronization [req-bb67439f-7c25-4dc4-8fee-862271071bb5 req-907f137b-e234-4465-8276-1766e55c435d tempest-FloatingIPsAssociationTestJSON-852158796 tempest-FloatingIPsAssociationTestJSON-852158796-project-member] Enqueued Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_members [ 790.963157] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_members [ 790.963157] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.963157] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.963157] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.964407] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.966127] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.966127] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.966127] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.966127] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.966280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.966280] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.972664] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.972741] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.972983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.972983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.973164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.984315] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 791.115921] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.116246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.116246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.117037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.117037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.117037] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b is going to be updated. [ 791.133564] env[65136]: INFO networking_nsxv3.common.synchronization [req-fe58e138-81ac-4d7b-9de0-5f3d3b7a8862 req-9e5da569-1818-4866-9825-d3aa836e2741 tempest-ServersNegativeTestMultiTenantJSON-1714821707 tempest-ServersNegativeTestMultiTenantJSON-1714821707-project-member] Enqueued Resource ID: 9f4dd229-f786-4bea-badc-2a0fea17968f with Priority: HIGHEST for action security_group_members [ 791.134286] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4dd229-f786-4bea-badc-2a0fea17968f with Priority: HIGHEST for action security_group_members [ 791.134743] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4dd229-f786-4bea-badc-2a0fea17968f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.135121] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.135287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.135679] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.135885] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.136043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.136146] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.136360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.136487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.136613] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f4dd229-f786-4bea-badc-2a0fea17968f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.148036] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.148036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.148036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.148255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.148338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.158259] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: IN_PROGRESS for 2s [ 791.226568] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 791.226802] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.249713] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.249988] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.249988] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.250440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.250440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.250573] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be updated. [ 791.324110] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.324317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.324317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.324502] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.324702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.337398] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: IN_PROGRESS for 2s [ 791.472427] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.640157] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.640157] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.640157] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.640157] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.640157] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.640157] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.640745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.640745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.640745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.640745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.640745] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f4dd229-f786-4bea-badc-2a0fea17968f is going to be updated. [ 791.646849] env[65136]: INFO networking_nsxv3.common.synchronization [None req-1d3edc85-0503-40db-8423-58ee8e6c5310 None None] Enqueued Resource ID: 21265231-fe86-46e0-9a4c-054b108e2779 with Priority: HIGHEST for action port [ 791.647378] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21265231-fe86-46e0-9a4c-054b108e2779 with Priority: HIGHEST for action port [ 791.647671] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-21265231-fe86-46e0-9a4c-054b108e2779 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.648793] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21265231-fe86-46e0-9a4c-054b108e2779" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.648793] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21265231-fe86-46e0-9a4c-054b108e2779" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.648793] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21265231-fe86-46e0-9a4c-054b108e2779" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.648793] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21265231-fe86-46e0-9a4c-054b108e2779',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.671712] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.671712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.671712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.671712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.671712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.681144] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f4dd229-f786-4bea-badc-2a0fea17968f in Status: IN_PROGRESS for 2s [ 791.840673] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb in Status: SUCCESS [ 791.840928] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb deletion is rescheduled due to dependency. [ 791.841071] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.977859] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.150124] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21265231-fe86-46e0-9a4c-054b108e2779 [ 792.151537] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.151537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.151537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.153178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.153178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.153178] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21265231-fe86-46e0-9a4c-054b108e2779 already deleted. [ 792.153178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21265231-fe86-46e0-9a4c-054b108e2779" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.486069] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.486069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.486069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.486069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.486069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.486069] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 is going to be updated. [ 792.527026] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.527026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.527026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.527026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.527026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.537404] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 in Status: IN_PROGRESS for 2s [ 792.997417] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 792.997417] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 deletion is rescheduled due to dependency. [ 792.997417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.169889] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: SUCCESS [ 793.170162] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.170375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.170609] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.170812] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.171047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.171118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.171408] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.171492] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.171588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.171723] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.350713] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: SUCCESS [ 793.350713] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.350713] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.350713] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.351557] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.351639] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.351739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.351880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.351968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.352589] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.683425] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.683425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.683425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.683425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.683856] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.683856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.683968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.684153] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.684270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.684433] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.684635] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.684754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.684865] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.685058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.685250] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.685376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.685483] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.685664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.685783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.685915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.686030] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.696704] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f4dd229-f786-4bea-badc-2a0fea17968f in Status: SUCCESS [ 793.696886] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f4dd229-f786-4bea-badc-2a0fea17968f deletion is rescheduled due to dependency. [ 793.697007] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4dd229-f786-4bea-badc-2a0fea17968f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.855709] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.855871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.855944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.856193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.856287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.856521] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.859274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.859274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.859274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.859274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.859274] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be updated. [ 793.886238] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.886474] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.886577] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.887942] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.888124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.899316] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: IN_PROGRESS for 2s [ 794.189230] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b: rpc.has_security_group_logging(os_id): False [ 794.214268] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.214268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.214268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.214268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.214268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.214268] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.214268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.214268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.214268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.214651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.214651] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.214651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.214769] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.214850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.214895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.215083] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.215173] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.215226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.215374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.215444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.215526] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b is going to be updated. [ 794.288780] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.288780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.288780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.288780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.288780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.326129] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: IN_PROGRESS for 2s [ 794.394179] env[65136]: INFO networking_nsxv3.common.synchronization [req-73b1e59c-4f59-4421-aeb0-36ee4df69195 req-08f3e634-1398-47e5-a244-862b9a022b13 tempest-TenantUsagesTestJSON-1373857105 tempest-TenantUsagesTestJSON-1373857105-project-member] Enqueued Resource ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e with Priority: HIGHEST for action security_group_members [ 794.397038] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e with Priority: HIGHEST for action security_group_members [ 794.397038] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.397038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.397038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.397038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.397038] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.397038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.397668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.397668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.397668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.397668] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.547886] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 in Status: SUCCESS [ 794.548134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.747311] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.748598] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.748598] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.748598] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.748967] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.749139] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.749238] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.749474] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.749674] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.750025] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.750025] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.750160] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.750273] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.750413] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.750548] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.751169] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.773027] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.773027] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 794.773027] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.773027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.773027] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-a7fe04a3-f8db-4397-95f2-c68f9b94f4fb taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.773027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-a7fe04a3-f8db-4397-95f2-c68f9b94f4fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.773027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-a7fe04a3-f8db-4397-95f2-c68f9b94f4fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.773027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-a7fe04a3-f8db-4397-95f2-c68f9b94f4fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.773027] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7fe04a3-f8db-4397-95f2-c68f9b94f4fb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.899418] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.899766] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.899895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.900115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.900211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.900435] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.900551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.900645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.900833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.900920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.901033] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e already deleted. [ 794.901118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.275850] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.276268] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.276567] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.276830] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.277048] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.277282] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port a7fe04a3-f8db-4397-95f2-c68f9b94f4fb not found, creating... [ 795.277616] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.277821] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.277981] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.278309] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.278493] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.278759] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.278898] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.279235] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.279572] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.279785] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.279977] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: a7fe04a3-f8db-4397-95f2-c68f9b94f4fb is going to be created. [ 795.314485] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.314721] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.314841] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.315163] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.316238] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.316238] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-a7fe04a3-f8db-4397-95f2-c68f9b94f4fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.908836] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: SUCCESS [ 795.909123] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 179594e5-59bd-41ce-8082-1aa739538096 deletion is rescheduled due to dependency. [ 795.909196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.039752] env[65136]: INFO networking_nsxv3.common.synchronization [req-73b1e59c-4f59-4421-aeb0-36ee4df69195 req-ebdc5d00-9181-4de9-8b2e-0010f24e7626 service nova] Enqueued Resource ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e with Priority: HIGHEST for action security_group_rules [ 796.039752] env[65136]: INFO networking_nsxv3.common.synchronization [req-73b1e59c-4f59-4421-aeb0-36ee4df69195 req-ebdc5d00-9181-4de9-8b2e-0010f24e7626 service nova] Enqueued Resource ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e with Priority: HIGHEST for action security_group_members [ 796.039752] env[65136]: INFO networking_nsxv3.common.synchronization [req-73b1e59c-4f59-4421-aeb0-36ee4df69195 req-ebdc5d00-9181-4de9-8b2e-0010f24e7626 service nova] Enqueued Resource ID: a7fe04a3-f8db-4397-95f2-c68f9b94f4fb with Priority: HIGHEST for action port [ 796.040026] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e with Priority: HIGHEST for action security_group_rules [ 796.040166] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e with Priority: HIGHEST for action security_group_members [ 796.040268] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7fe04a3-f8db-4397-95f2-c68f9b94f4fb with Priority: HIGHEST for action port [ 796.040541] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.040698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.040736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.040997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.041519] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.044091] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.044260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.044374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.044596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.044825] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.044955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.045062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.045242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.045358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.045774] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.047170] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7fe04a3-f8db-4397-95f2-c68f9b94f4fb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.048485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7fe04a3-f8db-4397-95f2-c68f9b94f4fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.048620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7fe04a3-f8db-4397-95f2-c68f9b94f4fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.048829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7fe04a3-f8db-4397-95f2-c68f9b94f4fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.048950] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7fe04a3-f8db-4397-95f2-c68f9b94f4fb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.339137] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: SUCCESS [ 796.339457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.544714] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.545313] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.550363] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.554218] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7fe04a3-f8db-4397-95f2-c68f9b94f4fb with status ACTIVE [ 796.554440] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.554693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.554693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.554853] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.555072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.555254] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.555254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.555254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.555410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.555459] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.555637] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.555795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.555824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.555950] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.556789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.556972] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7fe04a3-f8db-4397-95f2-c68f9b94f4fb is going to be updated. [ 796.579634] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.579634] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.579634] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.579634] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.579634] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.579854] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7fe04a3-f8db-4397-95f2-c68f9b94f4fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.797424] env[65136]: INFO networking_nsxv3.common.synchronization [req-a9b1490d-b08f-4e78-819d-20ac49917fe8 req-2b1e9f1c-79c1-4570-8369-3717ffd27f64 tempest-ServerRescueTestJSON-1597968343 tempest-ServerRescueTestJSON-1597968343-project-member] Enqueued Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_members [ 796.797989] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_members [ 796.798303] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-246d2702-c0f1-4486-92fb-beb4b3b1950e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.798429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.798542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.798852] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.798921] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.799162] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.799270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.799515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.799679] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.799777] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.842860] env[65136]: INFO networking_nsxv3.common.synchronization [None req-10885b54-dc95-44cd-8cde-c09532285a68 None None] Enqueued Resource ID: b636a42d-fe15-4fb1-9be4-36b7143b7783 with Priority: HIGHEST for action port [ 796.844132] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b636a42d-fe15-4fb1-9be4-36b7143b7783 with Priority: HIGHEST for action port [ 796.844476] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-b636a42d-fe15-4fb1-9be4-36b7143b7783 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.844605] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b636a42d-fe15-4fb1-9be4-36b7143b7783" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.844715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b636a42d-fe15-4fb1-9be4-36b7143b7783" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.844960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b636a42d-fe15-4fb1-9be4-36b7143b7783" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.845063] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b636a42d-fe15-4fb1-9be4-36b7143b7783',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.055322] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.302279] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.310557] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-722 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.312033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-722" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.312033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-722" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.312033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-722" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.312033] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.312033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.312033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.312033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.312033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.312434] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 797.312482] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.312567] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.312666] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.312767] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 797.312865] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.312987] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.337257] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.337257] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 797.337257] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.337257] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-722" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.337257] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-493e1897-b8c6-42b1-9068-8a8a8d703c15 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.337257] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-493e1897-b8c6-42b1-9068-8a8a8d703c15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.337257] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-493e1897-b8c6-42b1-9068-8a8a8d703c15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.339811] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-493e1897-b8c6-42b1-9068-8a8a8d703c15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.339811] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('493e1897-b8c6-42b1-9068-8a8a8d703c15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.347305] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b636a42d-fe15-4fb1-9be4-36b7143b7783 [ 797.347518] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.347650] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.347719] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.347920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.348010] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.348128] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b636a42d-fe15-4fb1-9be4-36b7143b7783 already deleted. [ 797.348202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b636a42d-fe15-4fb1-9be4-36b7143b7783" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.557756] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.557905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.557975] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.558211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.558296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.558389] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e is going to be created. [ 797.588031] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.588031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.588031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.588031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.588031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.599124] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e in Status: UNINITIALIZED for 2s [ 797.806124] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.841070] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.841337] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.841432] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.841721] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.841870] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.842033] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 493e1897-b8c6-42b1-9068-8a8a8d703c15 not found, creating... [ 797.843024] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.843024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.843024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.843024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.843320] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.843592] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.843787] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.843930] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.844291] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.844416] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.844694] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 493e1897-b8c6-42b1-9068-8a8a8d703c15 is going to be created. [ 797.864843] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.865279] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.865279] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.865533] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.866564] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.866564] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-493e1897-b8c6-42b1-9068-8a8a8d703c15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.309829] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.310923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.310923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.310923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.310923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.310923] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e is going to be updated. [ 798.340806] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.341189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.341189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.341327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.341692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.351294] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e in Status: IN_PROGRESS for 2s [ 798.586531] env[65136]: INFO networking_nsxv3.common.synchronization [req-a9b1490d-b08f-4e78-819d-20ac49917fe8 req-46a705a8-bcd8-4940-b4f5-ca526deafac7 service nova] Enqueued Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_rules [ 798.587062] env[65136]: INFO networking_nsxv3.common.synchronization [req-a9b1490d-b08f-4e78-819d-20ac49917fe8 req-46a705a8-bcd8-4940-b4f5-ca526deafac7 service nova] Enqueued Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_members [ 798.587062] env[65136]: INFO networking_nsxv3.common.synchronization [req-a9b1490d-b08f-4e78-819d-20ac49917fe8 req-46a705a8-bcd8-4940-b4f5-ca526deafac7 service nova] Enqueued Resource ID: 493e1897-b8c6-42b1-9068-8a8a8d703c15 with Priority: HIGHEST for action port [ 798.587521] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_rules [ 798.587699] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_members [ 798.587834] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 493e1897-b8c6-42b1-9068-8a8a8d703c15 with Priority: HIGHEST for action port [ 798.588167] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-246d2702-c0f1-4486-92fb-beb4b3b1950e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.588682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.588796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.589047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.589166] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.590653] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-246d2702-c0f1-4486-92fb-beb4b3b1950e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.590823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.592307] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-493e1897-b8c6-42b1-9068-8a8a8d703c15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.592307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-493e1897-b8c6-42b1-9068-8a8a8d703c15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.592307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-493e1897-b8c6-42b1-9068-8a8a8d703c15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.592651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-493e1897-b8c6-42b1-9068-8a8a8d703c15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.592651] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('493e1897-b8c6-42b1-9068-8a8a8d703c15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.929219] env[65136]: INFO networking_nsxv3.common.synchronization [None req-92521b2f-d7ae-4916-a74d-5aa03afae8b2 None None] Enqueued Resource ID: 8d0ad0f9-4324-4369-b0a8-6e3f6ea37098 with Priority: HIGHEST for action port [ 798.929219] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d0ad0f9-4324-4369-b0a8-6e3f6ea37098 with Priority: HIGHEST for action port [ 798.929219] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d0ad0f9-4324-4369-b0a8-6e3f6ea37098 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.929219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d0ad0f9-4324-4369-b0a8-6e3f6ea37098" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.929219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d0ad0f9-4324-4369-b0a8-6e3f6ea37098" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.929219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d0ad0f9-4324-4369-b0a8-6e3f6ea37098" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.929219] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d0ad0f9-4324-4369-b0a8-6e3f6ea37098',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.092398] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-246d2702-c0f1-4486-92fb-beb4b3b1950e taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.092542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.096557] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 493e1897-b8c6-42b1-9068-8a8a8d703c15 with status ACTIVE [ 799.096858] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.097223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.097223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.097315] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.097375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.097578] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.097685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.097749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.097905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.098035] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.098167] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.098258] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.098347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.098449] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.098681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.098681] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 493e1897-b8c6-42b1-9068-8a8a8d703c15 is going to be updated. [ 799.125123] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.125279] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.125349] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.125556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.125690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.125850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-493e1897-b8c6-42b1-9068-8a8a8d703c15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.433080] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d0ad0f9-4324-4369-b0a8-6e3f6ea37098 [ 799.433346] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.433477] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.433510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.433809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.433809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.433881] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d0ad0f9-4324-4369-b0a8-6e3f6ea37098 already deleted. [ 799.434148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d0ad0f9-4324-4369-b0a8-6e3f6ea37098" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.613948] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e in Status: SUCCESS [ 799.614227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.614423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.614664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.614912] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.615069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.615134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.615319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.615414] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.616902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.616902] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.770360] env[65136]: INFO networking_nsxv3.common.synchronization [req-f02d9fdb-6fad-4be1-9d0d-867f33d7c2c3 req-b465b75a-3ffd-4225-a2f6-dcc342e962ee tempest-ServersWithSpecificFlavorTestJSON-92176410 tempest-ServersWithSpecificFlavorTestJSON-92176410-project-member] Enqueued Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_members [ 799.770936] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_members [ 799.771263] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.771425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.771523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.771730] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.771919] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.772599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.772736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.775783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.775783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.775783] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.118601] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.118780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.118848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.119103] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.119269] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.119373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.119428] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.119594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.119719] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.119818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.119975] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.120229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.120229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.120316] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.120412] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.120483] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.120540] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.120671] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.120783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.120827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.121042] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.192737] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.193082] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.193082] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.193329] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.193939] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.194119] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.194282] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.194487] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.194854] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.194854] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 800.194990] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 800.195156] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 800.195225] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 800.195402] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 800.195457] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 800.195603] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 800.215971] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 800.216184] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 800.216375] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 800.216627] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.216992] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-fa7cd477-15b4-4c41-b131-c08e5fd7f124 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.217206] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-fa7cd477-15b4-4c41-b131-c08e5fd7f124" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.217333] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-fa7cd477-15b4-4c41-b131-c08e5fd7f124" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.217717] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-fa7cd477-15b4-4c41-b131-c08e5fd7f124" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.217821] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa7cd477-15b4-4c41-b131-c08e5fd7f124',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.276896] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.276896] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.277137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.277357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.277451] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.277735] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.277903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.277903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.278124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.278250] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.278322] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 is going to be updated. [ 800.311934] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.312185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.312265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.312589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.312914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.325151] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: IN_PROGRESS for 2s [ 800.362142] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e in Status: SUCCESS [ 800.362313] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.362489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.362701] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.362918] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.363058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.363130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.363292] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.363374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.363472] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.628417] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e: rpc.has_security_group_logging(os_id): False [ 800.646499] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.646712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.646789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.647013] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.647106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.647345] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.647444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.647510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.648603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.648603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.648603] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.648603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.648603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.648603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.648603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.648603] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.648603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.648996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.648996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.648996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.648996] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e is going to be created. [ 800.711468] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.711468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.711606] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.711735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.711922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.720012] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.720395] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.720395] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.720721] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.720888] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.721157] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port fa7cd477-15b4-4c41-b131-c08e5fd7f124 not found, creating... [ 800.721333] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.721454] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.721561] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.722517] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.722517] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.722517] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.722517] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.722517] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.722745] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.722745] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.723465] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: fa7cd477-15b4-4c41-b131-c08e5fd7f124 is going to be created. [ 800.726803] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e in Status: IN_PROGRESS for 2s [ 800.755993] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.755993] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.756205] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.756469] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.757400] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.757400] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-fa7cd477-15b4-4c41-b131-c08e5fd7f124" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.866121] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.368722] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.527409] env[65136]: INFO networking_nsxv3.common.synchronization [None req-3b7ea736-9e53-43ee-979a-cf924c626ed8 tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 with Priority: HIGHEST for action security_group_rules [ 801.529882] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 with Priority: HIGHEST for action security_group_rules [ 801.531146] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.531146] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.531339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.531966] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.531966] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbc78997-cbe5-4eed-9a43-9c7f00c61ec1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.607377] env[65136]: INFO networking_nsxv3.common.synchronization [req-f02d9fdb-6fad-4be1-9d0d-867f33d7c2c3 req-ab511ced-5603-4bef-ab89-ae5378a5e77d service nova] Enqueued Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_rules [ 801.607377] env[65136]: INFO networking_nsxv3.common.synchronization [req-f02d9fdb-6fad-4be1-9d0d-867f33d7c2c3 req-ab511ced-5603-4bef-ab89-ae5378a5e77d service nova] Enqueued Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_members [ 801.607377] env[65136]: INFO networking_nsxv3.common.synchronization [req-f02d9fdb-6fad-4be1-9d0d-867f33d7c2c3 req-ab511ced-5603-4bef-ab89-ae5378a5e77d service nova] Enqueued Resource ID: fa7cd477-15b4-4c41-b131-c08e5fd7f124 with Priority: HIGHEST for action port [ 801.607377] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_rules [ 801.607377] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_members [ 801.609963] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa7cd477-15b4-4c41-b131-c08e5fd7f124 with Priority: HIGHEST for action port [ 801.612432] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.612582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.612630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.612853] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.612944] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.614914] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.615059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.615547] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa7cd477-15b4-4c41-b131-c08e5fd7f124 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.616064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa7cd477-15b4-4c41-b131-c08e5fd7f124" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.616064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa7cd477-15b4-4c41-b131-c08e5fd7f124" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.616064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa7cd477-15b4-4c41-b131-c08e5fd7f124" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.616064] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa7cd477-15b4-4c41-b131-c08e5fd7f124',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.683593] env[65136]: INFO networking_nsxv3.common.synchronization [None req-e5e62f8b-2c6f-42c5-9fbd-f6445bef4c20 tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 with Priority: HIGHEST for action security_group_rules [ 801.684140] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 with Priority: HIGHEST for action security_group_rules [ 801.684434] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.684535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.872284] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.872669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.873954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.874288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.874481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.874481] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e is going to be updated. [ 801.911036] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.911036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.911036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.911238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.911274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.921966] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e in Status: IN_PROGRESS for 2s [ 802.056315] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.056480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.056533] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.057286] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.057286] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.057286] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 already deleted. [ 802.057286] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.057286] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.057286] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.057556] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbc78997-cbe5-4eed-9a43-9c7f00c61ec1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.118912] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.119073] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.119254] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa7cd477-15b4-4c41-b131-c08e5fd7f124 with status ACTIVE [ 802.119432] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.119590] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.119738] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.119892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.119983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.120178] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.120277] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.120350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.120528] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.120614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.120817] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.120909] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.120997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.121194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.121285] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.121393] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa7cd477-15b4-4c41-b131-c08e5fd7f124 is going to be updated. [ 802.146822] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.146998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.147063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.147296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.147445] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.147615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa7cd477-15b4-4c41-b131-c08e5fd7f124" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.354376] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: SUCCESS [ 802.355216] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 deletion is rescheduled due to dependency. [ 802.355216] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.355353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.356120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.356120] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.356120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.356120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.356516] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.356516] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.356618] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.578048] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.579207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.579207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.579207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.579207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.579207] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 already deleted. [ 802.579207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.743439] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e in Status: SUCCESS [ 802.743694] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.859393] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.363463] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.866057] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.866057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.866057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.866057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.866586] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.866586] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 is going to be updated. [ 803.899447] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.899549] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.899646] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.899898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.901443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.912380] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: IN_PROGRESS for 2s [ 803.933382] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e in Status: SUCCESS [ 803.933382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.933382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.933382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.933643] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.933643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.933755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.933922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.933969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.934097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.934188] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.440797] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-246d2702-c0f1-4486-92fb-beb4b3b1950e taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.440963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.441030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.441432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.441432] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.441561] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.441561] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.441820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.441820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.442086] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.442086] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-246d2702-c0f1-4486-92fb-beb4b3b1950e taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.442251] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.442251] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.442378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.442540] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.442653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.442717] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.442813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.442922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.443031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.443141] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.946025] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 246d2702-c0f1-4486-92fb-beb4b3b1950e: rpc.has_security_group_logging(os_id): False [ 804.964546] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.964546] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.964669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.964815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.965105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.965105] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.965976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.965976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.965976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.965976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.965976] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.965976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.965976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.965976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.966514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.966514] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.966514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.966514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.966514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.966713] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.966713] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e is going to be updated. [ 805.013536] env[65136]: INFO networking_nsxv3.common.synchronization [req-dc11abc5-b291-4d35-b06e-19bfc036fb3f req-85d6b3ca-50ee-4d1b-83a5-30b6d927bdf3 tempest-ServerRescueTestJSONUnderV235-188472497 tempest-ServerRescueTestJSONUnderV235-188472497-project-member] Enqueued Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_members [ 805.014848] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_members [ 805.014848] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.014848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.015089] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.015435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.015435] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.015623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.015966] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.015966] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.016090] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.016127] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.063028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.063028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.063310] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.063366] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.063521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.092874] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e in Status: IN_PROGRESS for 2s [ 805.471062] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.471062] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-844" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.471224] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-844" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.471449] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-844" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.471827] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.471980] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.472132] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.472371] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.472513] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.472722] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.472852] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.472930] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.473057] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.473165] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.473265] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.473391] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.500666] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.500924] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 805.501079] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.501475] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-844" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.502106] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-b25b41b0-2f15-4b6a-a7f2-76add682fe92 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.502428] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.502652] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.503234] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.503478] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b25b41b0-2f15-4b6a-a7f2-76add682fe92',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.519063] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.519227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.519347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.519669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.519787] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.520077] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.520235] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.520358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.520601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.520695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.520798] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62915302-b87a-442e-90fd-bf9466c47c0f already deleted. [ 805.520891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.926937] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: SUCCESS [ 805.926937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.926937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.926937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.926937] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.926937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.926937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.926937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.926937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.926937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.926937] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.007956] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.007956] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.007956] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.007956] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.007956] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.007956] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port b25b41b0-2f15-4b6a-a7f2-76add682fe92 not found, creating... [ 806.007956] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.007956] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.007956] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.008657] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.009294] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.009294] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.009589] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.009777] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.010162] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.010508] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.010720] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: b25b41b0-2f15-4b6a-a7f2-76add682fe92 is going to be created. [ 806.035189] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.035455] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.035766] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.036124] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.036637] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.036987] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.429040] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.796294] env[65136]: INFO networking_nsxv3.common.synchronization [req-dc11abc5-b291-4d35-b06e-19bfc036fb3f req-80351dea-64a5-4c60-a975-d6a69a7f369c service nova] Enqueued Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_rules [ 806.796618] env[65136]: INFO networking_nsxv3.common.synchronization [req-dc11abc5-b291-4d35-b06e-19bfc036fb3f req-80351dea-64a5-4c60-a975-d6a69a7f369c service nova] Enqueued Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_members [ 806.796799] env[65136]: INFO networking_nsxv3.common.synchronization [req-dc11abc5-b291-4d35-b06e-19bfc036fb3f req-80351dea-64a5-4c60-a975-d6a69a7f369c service nova] Enqueued Resource ID: b25b41b0-2f15-4b6a-a7f2-76add682fe92 with Priority: HIGHEST for action port [ 806.797861] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_rules [ 806.797989] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_members [ 806.798142] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b25b41b0-2f15-4b6a-a7f2-76add682fe92 with Priority: HIGHEST for action port [ 806.798441] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.798707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.798903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.799409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.799847] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.800628] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.800751] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.800821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.801019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.801295] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.801412] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.801479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.801633] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.801719] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.801816] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.802894] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-b25b41b0-2f15-4b6a-a7f2-76add682fe92 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.802894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.803060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.803224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.803301] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b25b41b0-2f15-4b6a-a7f2-76add682fe92',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.932687] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4d6bec9-6ca7-4853-ab37-11ad5c3e2917: rpc.has_security_group_logging(os_id): False [ 806.960834] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.960964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.960964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.961198] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.961266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.961511] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.961663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.961663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.961820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.961882] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.961972] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 is going to be updated. [ 807.036112] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.036763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.036763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.036763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.036763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.052900] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: IN_PROGRESS for 2s [ 807.108091] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e in Status: SUCCESS [ 807.108337] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.288891] env[65136]: INFO networking_nsxv3.common.synchronization [req-2fbdd098-21eb-4dc1-9a31-75c47314c502 req-0d736de5-bdd6-4fc9-bf5f-b1df512a9c96 tempest-ServersTestJSON-750370346 tempest-ServersTestJSON-750370346-project-member] Enqueued Resource ID: 4450efc3-afd8-4465-8453-713d205d5684 with Priority: HIGHEST for action security_group_members [ 807.289424] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4450efc3-afd8-4465-8453-713d205d5684 with Priority: HIGHEST for action security_group_members [ 807.289759] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4450efc3-afd8-4465-8453-713d205d5684 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.289905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.289998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.290469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.290753] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.290878] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.290939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.291119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.291198] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.291344] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4450efc3-afd8-4465-8453-713d205d5684',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.308030] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.308030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.308030] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.308030] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b25b41b0-2f15-4b6a-a7f2-76add682fe92 with status ACTIVE [ 807.308030] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.308030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.308030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.308030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.308030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.308030] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.308030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.308030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.308030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.308030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.309093] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.309093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.309093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.309093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.309093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.309093] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b25b41b0-2f15-4b6a-a7f2-76add682fe92 is going to be updated. [ 807.357024] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.357024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.357024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.357024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.357024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.357024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.796955] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.796955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.796955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.796955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.796955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.796955] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.796955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.796955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.796955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.796955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.796955] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4450efc3-afd8-4465-8453-713d205d5684 is going to be updated. [ 807.814750] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.829253] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.829466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.829888] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.829888] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.830072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.835659] env[65136]: INFO networking_nsxv3.common.synchronization [req-5d67ef8d-61f0-4f4e-9183-785085d3a345 req-65c0e91e-04cf-49b2-bc5e-14fdc0c31f67 tempest-ImagesNegativeTestJSON-831765486 tempest-ImagesNegativeTestJSON-831765486-project-member] Enqueued Resource ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc with Priority: HIGHEST for action security_group_members [ 807.836235] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc with Priority: HIGHEST for action security_group_members [ 807.836609] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.837114] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.837114] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.837269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.837299] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.837395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.837454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.838624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.838624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.838624] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea847179-b3cb-478f-bcdc-0c75dc43c2bc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.842202] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4450efc3-afd8-4465-8453-713d205d5684 in Status: IN_PROGRESS for 2s [ 808.319684] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.319684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.319684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.319684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.319684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.319684] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62915302-b87a-442e-90fd-bf9466c47c0f is going to be created. [ 808.338224] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-24 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.338224] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-24" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.338224] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-24" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.338224] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-24" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.338224] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.338224] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.338224] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.338224] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.338224] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.338894] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.338894] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 808.338894] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 808.338894] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 808.338894] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.338894] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 808.339188] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 808.340554] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.340702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.340769] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.340912] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.341025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.341319] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.341442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.341506] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.341633] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.341723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.341785] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc already deleted. [ 808.341870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.360156] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.360339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.360384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.360582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.360743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.369811] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: UNINITIALIZED for 2s [ 808.375184] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 808.375333] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 808.375486] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 808.375682] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-24" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.375989] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-194623ae-d34c-42fd-831a-73a815e6fa3b taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.376171] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-194623ae-d34c-42fd-831a-73a815e6fa3b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.376294] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-194623ae-d34c-42fd-831a-73a815e6fa3b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.376635] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-194623ae-d34c-42fd-831a-73a815e6fa3b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.376765] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('194623ae-d34c-42fd-831a-73a815e6fa3b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.880252] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.880571] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.880703] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.881207] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.881414] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.881615] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 194623ae-d34c-42fd-831a-73a815e6fa3b not found, creating... [ 808.881982] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.882172] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.882358] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.882948] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.882948] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.883385] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.883594] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.883751] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.884037] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.884254] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.884518] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 194623ae-d34c-42fd-831a-73a815e6fa3b is going to be created. [ 808.910747] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.911014] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.911162] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.911471] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.911722] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.911979] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-194623ae-d34c-42fd-831a-73a815e6fa3b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.066658] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: SUCCESS [ 809.066928] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.623976] env[65136]: INFO networking_nsxv3.common.synchronization [req-5d67ef8d-61f0-4f4e-9183-785085d3a345 req-02ae0aff-53f8-4395-b299-bfdba00e20d3 service nova] Enqueued Resource ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc with Priority: HIGHEST for action security_group_rules [ 809.624259] env[65136]: INFO networking_nsxv3.common.synchronization [req-5d67ef8d-61f0-4f4e-9183-785085d3a345 req-02ae0aff-53f8-4395-b299-bfdba00e20d3 service nova] Enqueued Resource ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc with Priority: HIGHEST for action security_group_members [ 809.624389] env[65136]: INFO networking_nsxv3.common.synchronization [req-5d67ef8d-61f0-4f4e-9183-785085d3a345 req-02ae0aff-53f8-4395-b299-bfdba00e20d3 service nova] Enqueued Resource ID: 194623ae-d34c-42fd-831a-73a815e6fa3b with Priority: HIGHEST for action port [ 809.624952] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc with Priority: HIGHEST for action security_group_rules [ 809.625113] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc with Priority: HIGHEST for action security_group_members [ 809.625211] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 194623ae-d34c-42fd-831a-73a815e6fa3b with Priority: HIGHEST for action port [ 809.625485] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea847179-b3cb-478f-bcdc-0c75dc43c2bc taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.625607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.625674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.625925] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.626033] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea847179-b3cb-478f-bcdc-0c75dc43c2bc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.626914] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.627038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.627121] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.627282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.627427] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.627520] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.627584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.627748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.627838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.627931] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea847179-b3cb-478f-bcdc-0c75dc43c2bc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.629264] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-194623ae-d34c-42fd-831a-73a815e6fa3b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.629264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-194623ae-d34c-42fd-831a-73a815e6fa3b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.629264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-194623ae-d34c-42fd-831a-73a815e6fa3b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.629406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-194623ae-d34c-42fd-831a-73a815e6fa3b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.629448] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('194623ae-d34c-42fd-831a-73a815e6fa3b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.852680] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4450efc3-afd8-4465-8453-713d205d5684 in Status: SUCCESS [ 809.853152] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4450efc3-afd8-4465-8453-713d205d5684 deletion is rescheduled due to dependency. [ 809.854296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4450efc3-afd8-4465-8453-713d205d5684" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.131672] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea847179-b3cb-478f-bcdc-0c75dc43c2bc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.134653] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.134653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.134653] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 194623ae-d34c-42fd-831a-73a815e6fa3b with status ACTIVE [ 810.134653] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.134653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.134653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.134653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.134653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.134653] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.134653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.134653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.134653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.134653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.134653] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.135426] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.135426] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.136322] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.136322] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.136322] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 194623ae-d34c-42fd-831a-73a815e6fa3b is going to be updated. [ 810.161580] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.161721] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.161788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.162018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.162160] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.162320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-194623ae-d34c-42fd-831a-73a815e6fa3b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.384555] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: SUCCESS [ 810.384907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.385176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.385403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.385705] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.386562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.386562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.386562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.386562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.386562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.386880] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.479925] env[65136]: INFO networking_nsxv3.common.synchronization [None req-25a38fbc-ef3d-40c8-8e20-53467f9b23cf None None] Enqueued Resource ID: c74ea818-f864-4e29-8768-2a46ab318225 with Priority: HIGHEST for action port [ 810.481122] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c74ea818-f864-4e29-8768-2a46ab318225 with Priority: HIGHEST for action port [ 810.481385] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-c74ea818-f864-4e29-8768-2a46ab318225 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.481615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c74ea818-f864-4e29-8768-2a46ab318225" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.481723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c74ea818-f864-4e29-8768-2a46ab318225" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.482170] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c74ea818-f864-4e29-8768-2a46ab318225" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.482665] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c74ea818-f864-4e29-8768-2a46ab318225',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.643080] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea847179-b3cb-478f-bcdc-0c75dc43c2bc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.889495] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.889917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.889917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.890252] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.890252] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.890352] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.890352] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.890529] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.890665] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.890719] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.890918] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.891049] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.891113] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.891266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.891412] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.891959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.892320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.892540] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.892634] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.892729] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.892828] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.984440] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c74ea818-f864-4e29-8768-2a46ab318225 [ 810.984874] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.985075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.985157] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.987030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.987030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.987030] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c74ea818-f864-4e29-8768-2a46ab318225 already deleted. [ 810.987030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c74ea818-f864-4e29-8768-2a46ab318225" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.145028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.145028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.145028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.145028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.145028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.145028] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc is going to be created. [ 811.176627] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.177238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.177446] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.177838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.178256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.192876] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc in Status: UNINITIALIZED for 2s [ 811.397641] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62915302-b87a-442e-90fd-bf9466c47c0f: rpc.has_security_group_logging(os_id): False [ 811.421240] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.421240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.421380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.421549] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.421643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.421867] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.421965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.422085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.422359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.422439] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.422627] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.422724] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.422823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.422921] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.422995] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.423241] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.423335] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.423431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.423532] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.423608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.423696] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62915302-b87a-442e-90fd-bf9466c47c0f is going to be created. [ 811.522597] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.522597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.522716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.524767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.524767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.542028] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: IN_PROGRESS for 2s [ 812.848133] env[65136]: INFO networking_nsxv3.common.synchronization [None req-2239a087-2490-4b8c-83a9-f3604a9edb20 None None] Enqueued Resource ID: fd4cccd6-5e6f-422b-ba3a-89b43c412451 with Priority: HIGHEST for action port [ 812.849816] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd4cccd6-5e6f-422b-ba3a-89b43c412451 with Priority: HIGHEST for action port [ 812.850380] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd4cccd6-5e6f-422b-ba3a-89b43c412451 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.850660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd4cccd6-5e6f-422b-ba3a-89b43c412451" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.850812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd4cccd6-5e6f-422b-ba3a-89b43c412451" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.851214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd4cccd6-5e6f-422b-ba3a-89b43c412451" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.851410] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd4cccd6-5e6f-422b-ba3a-89b43c412451',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.210373] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc in Status: SUCCESS [ 813.211322] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.211322] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.211521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.212365] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.212365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.212365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.212365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.212365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.212365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.212365] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea847179-b3cb-478f-bcdc-0c75dc43c2bc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.357774] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd4cccd6-5e6f-422b-ba3a-89b43c412451 [ 813.357774] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.357774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.357774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.357774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.357774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.357774] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd4cccd6-5e6f-422b-ba3a-89b43c412451 already deleted. [ 813.357774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd4cccd6-5e6f-422b-ba3a-89b43c412451" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.559651] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: SUCCESS [ 813.559651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.716198] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.716382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.716472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.716843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.717125] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.717220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.717348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.717554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.717688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.717815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.722182] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.722427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.722531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.722796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.723038] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.723132] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.723210] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.723416] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.723519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.723643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.723762] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea847179-b3cb-478f-bcdc-0c75dc43c2bc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.229229] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea847179-b3cb-478f-bcdc-0c75dc43c2bc: rpc.has_security_group_logging(os_id): False [ 814.251167] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.251317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.251462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.252288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.253405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.253405] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.253405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.253405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.253972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.253972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.254100] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.254252] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.254382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.254597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.254695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.254897] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.254999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.255142] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.255337] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.255467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.255568] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc is going to be created. [ 814.320618] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.320899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.320899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.321087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.321256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.337071] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc in Status: IN_PROGRESS for 2s [ 814.621611] env[65136]: INFO networking_nsxv3.common.synchronization [req-9f8dc99b-1a8a-49cb-b770-3bc818504c68 req-ea1f0195-8efd-426c-ae1c-3e2e86b509e1 tempest-ListServersNegativeTestJSON-1898468254 tempest-ListServersNegativeTestJSON-1898468254-project-member] Enqueued Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 814.622159] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 814.622458] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.622577] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.622767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.622829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.622976] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.623265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.623333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.623482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.623570] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.623662] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.126392] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.176254] env[65136]: INFO networking_nsxv3.common.synchronization [req-75a711ad-1e2d-498d-8698-7335582d095c req-1fad17e6-b1ae-4154-ba7e-72adfcbd66a0 tempest-ListServersNegativeTestJSON-1898468254 tempest-ListServersNegativeTestJSON-1898468254-project-member] Enqueued Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 815.176979] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGHEST for action security_group_members [ 815.177428] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.177674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.632604] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.137861] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.138120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.138120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.139491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.139491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.139491] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287b8551-3bf8-4455-afb3-b406697983a1 is going to be updated. [ 816.190376] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.190376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.190376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.190671] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.190708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.201812] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: IN_PROGRESS for 2s [ 816.350933] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc in Status: SUCCESS [ 816.350933] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.212596] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: SUCCESS [ 818.213119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.214107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.214620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.214620] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.214620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.214620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.215111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.215111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.215111] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.220018] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.220280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.220397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.220547] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.220698] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.719031] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.719031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.719031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.719031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.719031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.719031] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.719031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.719031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.719031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.719031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.719031] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287b8551-3bf8-4455-afb3-b406697983a1 is going to be updated. [ 818.722042] env[65136]: INFO networking_nsxv3.common.synchronization [req-acabfc64-06b3-47e4-b749-1ab8606535c0 req-3a06f979-3846-4c9b-a7c6-afa00fcb663a tempest-TenantUsagesTestJSON-1373857105 tempest-TenantUsagesTestJSON-1373857105-project-member] Enqueued Resource ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e with Priority: HIGHEST for action security_group_members [ 818.722706] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e with Priority: HIGHEST for action security_group_members [ 818.723023] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.723150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.723208] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.723370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.723512] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.723596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.723653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.723798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.723880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.723965] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.724843] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.754482] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.754833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.754833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.754998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.755124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.765551] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: IN_PROGRESS for 2s [ 819.227591] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.228036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.228036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.228447] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.228447] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.228541] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.228704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.228783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.228944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.229731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.229731] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e is going to be updated. [ 819.232800] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.266727] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.266982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.266982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.267358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.267358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.285397] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e in Status: IN_PROGRESS for 2s [ 819.735840] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 819.735947] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 820.754154] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.754511] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.754511] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.755761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.769449] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 820.770462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.771687] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 820.782840] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 287b8551-3bf8-4455-afb3-b406697983a1 in Status: SUCCESS [ 820.783044] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 287b8551-3bf8-4455-afb3-b406697983a1 deletion is rescheduled due to dependency. [ 820.783176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.803453] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.803606] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.803675] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.803908] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.811319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.811929] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 820.812025] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 820.812108] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 820.851565] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.851565] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.851565] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.851565] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.852779] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.853034] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 820.918742] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.918742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.918742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.918742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.919648] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.919648] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 820.977717] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.977889] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.977947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.978187] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.978417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.978746] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:37. [ 820.978848] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b4d6bec9-6ca7-4853-ab37-11ad5c3e2917', '2ffd4802-244f-43db-9a7c-a5a1b6672fde', '2e54885c-f399-4f6d-8492-fac933ed5006', 'd3db224c-b3c3-47ed-ae74-91d6ec4d268c', '4b70c67f-c559-421c-8bdc-2943731f1140', '0b753815-728e-4ba2-a7f0-1eb90d70cc2a', '6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b', 'ee57c421-9f97-4726-90f3-a34f9975cc5b', '4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd', '179594e5-59bd-41ce-8082-1aa739538096', '837b8c63-6d80-45d3-a9be-427d83c5b42a', '341154f1-9b0b-43bc-8e74-163cf220f74c', '287b8551-3bf8-4455-afb3-b406697983a1', 'd789ffc8-c337-422a-bd53-59d582b7cf8f', '605661ba-c8c2-4dae-8382-f55a5d1ead5d', '4016a6d9-0970-467e-9687-5ce3a39e3775', '171f535d-ebee-432f-b393-d063259af9b9', '7767bb26-265a-4c1f-9c68-9bd50a08bacb', '7f41536b-89cc-4053-984d-cc435f2aab48', 'f5ef8f7d-8350-4fe2-9bef-70ff70b5f141', 'a3377341-8fcc-4f3f-b4b7-a51279fee1e6', '246d2702-c0f1-4486-92fb-beb4b3b1950e', 'c9e25239-cb71-43b7-9bce-b16b700986d4', 'dbb8b9b9-cf98-4843-a063-345334ac585b', '4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b', 'c713a5b4-d91d-4c9c-8670-3e057521cf54', '06b0bf22-61b9-4a96-a3f3-ec08a80369b4', '93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5', '988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15', '00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e', '5640a309-d0fa-4870-9eee-f2caeb1f4b8d', 'ea847179-b3cb-478f-bcdc-0c75dc43c2bc', '9f4dd229-f786-4bea-badc-2a0fea17968f', '62915302-b87a-442e-90fd-bf9466c47c0f', '39322202-687d-409e-86ef-4870f36135e8', '4450efc3-afd8-4465-8453-713d205d5684', '5a04e899-b185-4f20-8eea-e0edb95feabb'} {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 820.978946] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 821.000240] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.000240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.000240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.000240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.000240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.000240] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 821.000240] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 821.000240] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 821.073021] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.073021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.073021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.073021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.074183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.074641] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 821.075420] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 821.075420] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 821.075420] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 821.075420] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/37 resources of Type:Security Group Rules [ 821.075420] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGH for action security_group_rules [ 821.075420] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGH for action security_group_rules [ 821.075420] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2e54885c-f399-4f6d-8492-fac933ed5006 with Priority: HIGH for action security_group_rules [ 821.075420] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c with Priority: HIGH for action security_group_rules [ 821.075420] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b70c67f-c559-421c-8bdc-2943731f1140 with Priority: HIGH for action security_group_rules [ 821.075420] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a with Priority: HIGH for action security_group_rules [ 821.075743] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGH for action security_group_rules [ 821.075743] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGH for action security_group_rules [ 821.075743] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd with Priority: HIGH for action security_group_rules [ 821.075743] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGH for action security_group_rules [ 821.075871] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a with Priority: HIGH for action security_group_rules [ 821.075871] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGH for action security_group_rules [ 821.075871] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGH for action security_group_rules [ 821.075962] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d789ffc8-c337-422a-bd53-59d582b7cf8f with Priority: HIGH for action security_group_rules [ 821.075992] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGH for action security_group_rules [ 821.076074] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 with Priority: HIGH for action security_group_rules [ 821.076310] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGH for action security_group_rules [ 821.076398] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGH for action security_group_rules [ 821.076581] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7f41536b-89cc-4053-984d-cc435f2aab48 with Priority: HIGH for action security_group_rules [ 821.076640] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGH for action security_group_rules [ 821.076740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.298512] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e in Status: SUCCESS [ 821.298512] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e deletion is rescheduled due to dependency. [ 821.298512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.549190] env[65136]: INFO networking_nsxv3.common.synchronization [req-d405a231-ec26-4eab-9825-76f8f4230652 req-b8a58bfe-52a9-44b6-a635-ad1931075c00 tempest-ServerDiskConfigTestJSON-1818502390 tempest-ServerDiskConfigTestJSON-1818502390-project-member] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 821.549630] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 821.549788] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGH for action security_group_rules [ 821.550013] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e54885c-f399-4f6d-8492-fac933ed5006 with Priority: HIGH for action security_group_rules [ 821.550013] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGH for action security_group_rules [ 821.550868] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGH for action security_group_rules [ 821.550988] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGH for action security_group_rules [ 821.551058] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f41536b-89cc-4053-984d-cc435f2aab48 with Priority: HIGH for action security_group_rules [ 821.551181] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb with Priority: HIGH for action security_group_rules [ 821.551380] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGH for action security_group_rules [ 821.551380] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d789ffc8-c337-422a-bd53-59d582b7cf8f with Priority: HIGH for action security_group_rules [ 821.551486] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 with Priority: HIGH for action security_group_rules [ 821.551560] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 287b8551-3bf8-4455-afb3-b406697983a1 with Priority: HIGH for action security_group_rules [ 821.551661] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGH for action security_group_rules [ 821.551753] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a with Priority: HIGH for action security_group_rules [ 821.551843] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGH for action security_group_rules [ 821.551933] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd with Priority: HIGH for action security_group_rules [ 821.552059] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a with Priority: HIGH for action security_group_rules [ 821.552164] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGH for action security_group_rules [ 821.552374] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b70c67f-c559-421c-8bdc-2943731f1140 with Priority: HIGH for action security_group_rules [ 821.552374] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGH for action security_group_rules [ 821.552484] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c with Priority: HIGH for action security_group_rules [ 821.552731] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.552857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.552922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.553184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.553408] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.553518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.553575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.553850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.553850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.553929] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.555918] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.556056] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.556128] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.556298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.556412] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.557315] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e54885c-f399-4f6d-8492-fac933ed5006 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.557425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.557491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.557644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.557998] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e54885c-f399-4f6d-8492-fac933ed5006',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.558475] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.558631] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.558753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.558836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.558905] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.560452] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.560577] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.560650] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.560810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.560901] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.562109] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.562218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.562218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.562368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.562438] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.563332] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f41536b-89cc-4053-984d-cc435f2aab48 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.563444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.563510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.563658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.563730] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f41536b-89cc-4053-984d-cc435f2aab48',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.564573] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.564680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.564746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.564897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.564968] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7767bb26-265a-4c1f-9c68-9bd50a08bacb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.570903] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.571081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.571152] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.571390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.571485] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.572463] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d789ffc8-c337-422a-bd53-59d582b7cf8f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.572580] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.572650] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.572831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.572991] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d789ffc8-c337-422a-bd53-59d582b7cf8f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.574417] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4016a6d9-0970-467e-9687-5ce3a39e3775 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.574540] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.574625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.575245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.575245] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4016a6d9-0970-467e-9687-5ce3a39e3775',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.575245] env[65136]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 821.575908] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-287b8551-3bf8-4455-afb3-b406697983a1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.576027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.576254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.576412] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.576488] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('287b8551-3bf8-4455-afb3-b406697983a1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.577380] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.577487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.577553] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.578790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.578904] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.579784] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-837b8c63-6d80-45d3-a9be-427d83c5b42a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.579889] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.579955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.580121] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.580193] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('837b8c63-6d80-45d3-a9be-427d83c5b42a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.581185] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.581316] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.581377] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.581850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.581850] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.582384] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.582480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.582588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.582687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.582753] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.584480] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.584480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.584480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.584480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.584480] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b753815-728e-4ba2-a7f0-1eb90d70cc2a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.585326] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.585512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.585512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.585692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.585692] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.587220] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b70c67f-c559-421c-8bdc-2943731f1140 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.587220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.587220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.587220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.587220] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b70c67f-c559-421c-8bdc-2943731f1140',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.588078] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.588078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.588078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.588078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.588227] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.589542] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.589542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.589542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.591012] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.591012] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3db224c-b3c3-47ed-ae74-91d6ec4d268c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.591012] env[65136]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 821.956618] env[65136]: INFO networking_nsxv3.common.synchronization [req-9a93a332-3176-47d2-ba96-18e022db020c req-6fa04a30-b646-439b-a3be-8004c30d68e9 tempest-ImagesTestJSON-1051903205 tempest-ImagesTestJSON-1051903205-project-member] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 821.957558] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 821.957558] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.957727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.957727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.957921] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.958198] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.958281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.958343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.958480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.958646] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.958761] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.096329] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.096329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.096329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.096329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.098495] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.098495] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.098747] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.099504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.100178] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.100178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.100857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.100857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.100857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.100857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.101192] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.124912] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.125031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.128766] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.129062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.129062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.129269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.129487] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.129652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.129753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.129918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.130016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.130105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.130195] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.133555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.133798] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.133917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.133983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.134209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.134296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.134393] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be updated. [ 822.145087] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.145213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.145213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.146278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.146278] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.146278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.146278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.146868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.146989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.147088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.147207] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.154036] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.154036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.154036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.154036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.154036] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.154036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.154036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.154636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.154636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.154636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.154636] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.168379] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.168379] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.168379] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.168810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.169153] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.170358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.170358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.170358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.170358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.170358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.170358] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.171219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.171463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.176572] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.176745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.240845] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.241101] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.242710] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.242710] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.242710] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.242710] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.243796] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.243947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.244856] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.244856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.248192] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.248192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.248192] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.248192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.248192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.248882] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e54885c-f399-4f6d-8492-fac933ed5006 is going to be deleted. [ 822.249628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.250320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.251696] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.251949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.254158] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.254158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.256480] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.256480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.261460] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 822.262198] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.262313] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.263443] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 822.263987] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.264256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.264995] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 822.265458] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.265613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.265687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.265952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.266271] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.268317] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.268463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.274552] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 822.276578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.276578] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 287b8551-3bf8-4455-afb3-b406697983a1 is going to be deleted. [ 822.277045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.277231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.279429] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 822.304324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.304505] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be deleted. [ 822.305443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.305962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.306150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.306319] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be deleted. [ 822.307254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.307548] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.334345] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.334582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.340915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.341078] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b70c67f-c559-421c-8bdc-2943731f1140 is going to be deleted. [ 822.342047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.342268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.389129] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.389359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.394226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.394361] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd is going to be deleted. [ 822.395328] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.395546] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.440322] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-63 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.440643] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.440827] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.441977] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.442400] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.442524] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.442659] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.442917] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.443135] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.443627] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.443804] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.443936] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.444132] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.444233] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.444310] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.444717] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.462204] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.462297] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.462716] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.462716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.463836] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.463955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.477523] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.478179] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.493639] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.493860] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d789ffc8-c337-422a-bd53-59d582b7cf8f is going to be deleted. [ 822.494846] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.495176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.509717] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.510075] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.065 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 822.510252] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.510447] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.511032] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-4ee04dc3-9332-4a43-a01c-7515bcf9a829 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.511289] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-4ee04dc3-9332-4a43-a01c-7515bcf9a829" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.511430] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-4ee04dc3-9332-4a43-a01c-7515bcf9a829" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.512049] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-4ee04dc3-9332-4a43-a01c-7515bcf9a829" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.512269] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ee04dc3-9332-4a43-a01c-7515bcf9a829',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.604382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.604528] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b753815-728e-4ba2-a7f0-1eb90d70cc2a is going to be deleted. [ 822.605798] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.606868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.607158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.637010] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.637010] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.669509] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.669731] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4016a6d9-0970-467e-9687-5ce3a39e3775 is going to be deleted. [ 822.671128] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.671401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.675846] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.676388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.677295] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.677474] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.677562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.677777] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.677988] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.678119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.678185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.678344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.678457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.678549] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.679035] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.679174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.679243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.679392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.680015] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.680015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.680015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.680015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.680211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.680211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.680272] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.683132] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.683295] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.683387] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.683636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.683851] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.683997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.684099] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.684295] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.684652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.684652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.684652] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.684857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.684857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.684955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.685123] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.685217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.685292] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.685818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.685932] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.686033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.686167] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.687789] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.687922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.687965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.688810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.689349] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.689585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.689585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.689842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.689842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.689950] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.690120] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.690231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.690311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.690417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.690561] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.690649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.690701] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.690841] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.690916] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.690998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.691100] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.694041] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.752618] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.752618] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b is going to be deleted. [ 822.753615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.753886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.845101] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.845101] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 837b8c63-6d80-45d3-a9be-427d83c5b42a is going to be deleted. [ 822.846079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.846339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.848237] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.848237] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.889424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.890411] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f41536b-89cc-4053-984d-cc435f2aab48 is going to be deleted. [ 822.891770] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.892106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.919831] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.920088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.978383] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.979887] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.985202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.985202] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3db224c-b3c3-47ed-ae74-91d6ec4d268c is going to be deleted. [ 822.985892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.986417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.996504] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.996728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.010897] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.011146] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.015791] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.016025] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.016199] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.016477] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.016621] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.016783] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 4ee04dc3-9332-4a43-a01c-7515bcf9a829 not found, creating... [ 823.017045] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.017256] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.017435] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.017680] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.017824] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.018143] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.018297] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.018411] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.018685] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.018823] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.018965] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 4ee04dc3-9332-4a43-a01c-7515bcf9a829 is going to be created. [ 823.058886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.059088] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7767bb26-265a-4c1f-9c68-9bd50a08bacb is going to be deleted. [ 823.060038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.060269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.110824] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4d6bec9-6ca7-4853-ab37-11ad5c3e2917: rpc.has_security_group_logging(os_id): False [ 823.126508] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.126887] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.127101] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.127701] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.127701] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.128024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-4ee04dc3-9332-4a43-a01c-7515bcf9a829" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.145130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.145312] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be deleted. [ 823.146505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.146954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.147304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.147342] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e54885c-f399-4f6d-8492-fac933ed5006" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.147551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.147783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.147887] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.148041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-287b8551-3bf8-4455-afb3-b406697983a1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.148778] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.148986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.149126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.149208] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.149355] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.149736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.152974] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.153192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.183925] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b: rpc.has_security_group_logging(os_id): False [ 823.186108] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.186241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.193163] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 171f535d-ebee-432f-b393-d063259af9b9: rpc.has_security_group_logging(os_id): False [ 823.194285] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5ef8f7d-8350-4fe2-9bef-70ff70b5f141: rpc.has_security_group_logging(os_id): False [ 823.195792] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 341154f1-9b0b-43bc-8e74-163cf220f74c: rpc.has_security_group_logging(os_id): False [ 823.207177] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.207177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.223453] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.223627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.240622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.241087] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.241228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.241290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.241579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.241648] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.241805] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 823.243155] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.243832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.243832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.243832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.244049] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.244194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.244267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.244667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b70c67f-c559-421c-8bdc-2943731f1140" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.245162] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.245401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.245532] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.245697] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ea87115-bf3c-4aa1-85c1-be8fa15fb2bd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.245921] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.246147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.246218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.246355] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d789ffc8-c337-422a-bd53-59d582b7cf8f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.246514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.246742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.246852] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.247046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b753815-728e-4ba2-a7f0-1eb90d70cc2a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.247198] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.247425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.247556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.247787] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4016a6d9-0970-467e-9687-5ce3a39e3775" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.249412] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.249944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.249944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.249944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.287207] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.287408] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.288331] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.288440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.316821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.317329] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.317522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.317653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.317934] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.318979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.318979] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.318979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.318979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.318979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.319269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.319384] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.319522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.319636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.319948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.320103] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.320268] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 823.321912] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.322729] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.322958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.323161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f41536b-89cc-4053-984d-cc435f2aab48" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.323364] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.323590] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.323714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.324519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-837b8c63-6d80-45d3-a9be-427d83c5b42a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.324709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.324884] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.339171] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.339433] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.358329] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.358493] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.358600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.358823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.359054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.370618] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 823.371355] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 823.371886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.372221] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.372370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.372440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.372666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.372753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.372849] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 is going to be updated. [ 823.374431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.374627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.374716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.375024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7767bb26-265a-4c1f-9c68-9bd50a08bacb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.375024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.375991] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.433293] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.433403] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.433466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.433514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.433773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.433891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.435454] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.435454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.435454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.435454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.435454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.435454] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.435454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.435454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.435454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.435454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.435454] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b is going to be updated. [ 823.438994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.438994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.493224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.494147] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.494751] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.495181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.495181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.495362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.495490] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.495640] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.495640] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.495844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.496246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.496402] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.496597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.496712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.496934] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.497082] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.497251] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be updated. [ 823.499591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.500023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.500023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.504037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3db224c-b3c3-47ed-ae74-91d6ec4d268c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.504037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.504037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.504037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.504037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.504037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.504037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.504037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.504037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.504037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.504037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.529174] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.529304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.553050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.553380] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.553499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.553562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.553767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.554433] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.554433] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c is going to be updated. [ 823.555599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.555807] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.555956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.580985] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 823.604797] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.605031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.605031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.605255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.605399] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.621054] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.621054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.621054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.621054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.621054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.649662] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.649858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.649926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.650176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.650336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.655604] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: IN_PROGRESS for 2s [ 823.656260] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: IN_PROGRESS for 2s [ 823.683057] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: IN_PROGRESS for 2s [ 823.763023] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 823.763644] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.763794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.763870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.764087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.764233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.782023] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: IN_PROGRESS for 2s [ 823.782023] env[65136]: INFO networking_nsxv3.common.synchronization [req-9a93a332-3176-47d2-ba96-18e022db020c req-f79ae782-2bec-47e5-b08f-bcd18cbfbe45 service nova] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_rules [ 823.782023] env[65136]: INFO networking_nsxv3.common.synchronization [req-9a93a332-3176-47d2-ba96-18e022db020c req-f79ae782-2bec-47e5-b08f-bcd18cbfbe45 service nova] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 823.782023] env[65136]: INFO networking_nsxv3.common.synchronization [req-9a93a332-3176-47d2-ba96-18e022db020c req-f79ae782-2bec-47e5-b08f-bcd18cbfbe45 service nova] Enqueued Resource ID: 4ee04dc3-9332-4a43-a01c-7515bcf9a829 with Priority: HIGHEST for action port [ 823.783110] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_rules [ 823.783529] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 823.783837] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ee04dc3-9332-4a43-a01c-7515bcf9a829 with Priority: HIGHEST for action port [ 823.787023] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.787023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.787023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.787023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.787023] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.787023] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.787023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.791643] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ee04dc3-9332-4a43-a01c-7515bcf9a829 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.791643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ee04dc3-9332-4a43-a01c-7515bcf9a829" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.791643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ee04dc3-9332-4a43-a01c-7515bcf9a829" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.791643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ee04dc3-9332-4a43-a01c-7515bcf9a829" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.791643] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ee04dc3-9332-4a43-a01c-7515bcf9a829',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.965022] env[65136]: INFO networking_nsxv3.common.synchronization [req-bdc3a9b0-891b-418a-95d0-890fac05ab48 req-ed7cd9aa-77ad-4320-924b-90fc65ba67e0 tempest-FloatingIPsAssociationTestJSON-852158796 tempest-FloatingIPsAssociationTestJSON-852158796-project-member] Enqueued Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_members [ 823.965022] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 with Priority: HIGHEST for action security_group_members [ 823.965022] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.965022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.965022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.965022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.965022] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.965464] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.965464] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.965464] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.965857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.965857] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06b0bf22-61b9-4a96-a3f3-ec08a80369b4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.290823] env[65136]: INFO networking_nsxv3.common.synchronization [req-e3d5c63f-fd9f-481d-a46e-59bc92db00d5 req-55bec205-8251-4ca7-b70a-e17aa631ded9 tempest-ImagesNegativeTestJSON-831765486 tempest-ImagesNegativeTestJSON-831765486-project-member] Enqueued Resource ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc with Priority: HIGHEST for action security_group_members [ 824.291402] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc with Priority: HIGHEST for action security_group_members [ 824.291723] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.291849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.291925] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.292164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.292318] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.292425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.292481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.292610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.292693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.292787] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea847179-b3cb-478f-bcdc-0c75dc43c2bc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.295936] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.295936] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.300028] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ee04dc3-9332-4a43-a01c-7515bcf9a829 with status ACTIVE [ 824.300028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.300028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.300028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.300028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.300028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.300028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.300028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.300028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.300028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.300028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.300028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.300028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.300028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.300028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.300028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.300028] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ee04dc3-9332-4a43-a01c-7515bcf9a829 is going to be updated. [ 824.303754] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 824.303754] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d deletion is rescheduled due to dependency. [ 824.303891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.323261] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.323448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.323524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.324018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.324018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.324154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ee04dc3-9332-4a43-a01c-7515bcf9a829" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.472668] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.472668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.472668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.472668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.502733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.503620] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.503620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.503620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.503815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.503815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.503887] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 is going to be updated. [ 824.538032] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.538182] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.538272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.538495] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.538755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.547806] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 in Status: IN_PROGRESS for 2s [ 824.800454] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.800622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.800706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.800944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.823398] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.823681] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.823868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.823868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.824071] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.824152] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.824240] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc is going to be updated. [ 824.855161] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.856402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.856402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.856402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.856402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.867196] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc in Status: IN_PROGRESS for 2s [ 825.382107] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 825.382446] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 deletion is rescheduled due to dependency. [ 825.382558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.382764] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.383048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.383288] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.383423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.383489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.383707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.383809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.383961] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.599953] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 825.600554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.670206] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: SUCCESS [ 825.673744] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.673744] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 825.673744] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.700221] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: SUCCESS [ 825.700752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.793203] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: SUCCESS [ 825.793436] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.885764] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.389222] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.559614] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 in Status: SUCCESS [ 826.559614] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06b0bf22-61b9-4a96-a3f3-ec08a80369b4 deletion is rescheduled due to dependency. [ 826.559614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06b0bf22-61b9-4a96-a3f3-ec08a80369b4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.877418] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc in Status: SUCCESS [ 826.877622] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea847179-b3cb-478f-bcdc-0c75dc43c2bc deletion is rescheduled due to dependency. [ 826.877739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea847179-b3cb-478f-bcdc-0c75dc43c2bc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.894330] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.894330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.894461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.894721] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.894852] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.895018] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 826.935032] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.935032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.935032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.936628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.939020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.949535] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 827.599646] env[65136]: INFO networking_nsxv3.common.synchronization [req-66e9ce0c-803c-4e20-92c1-95da177c95bf req-e511ce0c-5fb7-44f6-b224-7c962203e977 tempest-InstanceActionsTestJSON-1152952087 tempest-InstanceActionsTestJSON-1152952087-project-member] Enqueued Resource ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 with Priority: HIGHEST for action security_group_members [ 827.601115] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 with Priority: HIGHEST for action security_group_members [ 827.601115] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.601115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.601332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.601467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.601633] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.601761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.601991] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.602168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.602471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.602471] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed7ec91e-a13b-4082-ab28-c92b4852a8c3',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.985840] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-729 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.986258] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-729" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.986437] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-729" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.986799] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-729" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.987100] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.987277] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.987422] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.987694] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.987869] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.988104] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.988216] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.988337] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.988453] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.988559] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.988711] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.988865] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.016825] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.016825] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 828.016825] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.016825] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-729" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.016825] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-3fd1ef91-b049-4b11-8c51-2639db8b0292 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.016825] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-3fd1ef91-b049-4b11-8c51-2639db8b0292" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.016825] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-3fd1ef91-b049-4b11-8c51-2639db8b0292" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.016825] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-3fd1ef91-b049-4b11-8c51-2639db8b0292" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.016825] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fd1ef91-b049-4b11-8c51-2639db8b0292',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.105320] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.105580] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.105680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.106034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.106159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.106521] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.106656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.106761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.106991] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.107140] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.107295] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 already deleted. [ 828.107424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.523416] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.523695] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.523768] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.524094] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.524244] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.524416] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 3fd1ef91-b049-4b11-8c51-2639db8b0292 not found, creating... [ 828.524724] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.524921] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.525055] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.525290] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.525428] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.525719] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.525909] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.526080] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.526305] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.526499] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.526688] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 3fd1ef91-b049-4b11-8c51-2639db8b0292 is going to be created. [ 828.547896] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.548213] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.548403] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.548695] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.549056] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.549374] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-3fd1ef91-b049-4b11-8c51-2639db8b0292" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.595566] env[65136]: INFO networking_nsxv3.common.synchronization [req-491006a1-c58a-4ca3-8f11-38938f8e9bd5 req-39efad2e-b0f2-4c03-a3f2-2f12569d40de tempest-ServersV294TestFqdnHostnames-1024632663 tempest-ServersV294TestFqdnHostnames-1024632663-project-member] Enqueued Resource ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d with Priority: HIGHEST for action security_group_members [ 828.596206] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d with Priority: HIGHEST for action security_group_members [ 828.596522] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.596656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.596725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.596926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.597203] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.597314] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.597378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.597547] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.597637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.597744] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5640a309-d0fa-4870-9eee-f2caeb1f4b8d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.961549] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 828.962234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.962569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.962994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.963268] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.964311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.964421] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.964629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.964731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.964822] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.964918] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.100510] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.100671] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.100745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.100965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.131341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.131666] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.131858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.131920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.132120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.132217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.132315] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d is going to be updated. [ 829.171659] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.172832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.172926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.173472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.173668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.184493] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d in Status: IN_PROGRESS for 2s [ 829.308667] env[65136]: INFO networking_nsxv3.common.synchronization [req-66e9ce0c-803c-4e20-92c1-95da177c95bf req-df7f9fb5-c03e-4fd9-8de9-a5ca3ddf8c11 service nova] Enqueued Resource ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 with Priority: HIGHEST for action security_group_rules [ 829.308882] env[65136]: INFO networking_nsxv3.common.synchronization [req-66e9ce0c-803c-4e20-92c1-95da177c95bf req-df7f9fb5-c03e-4fd9-8de9-a5ca3ddf8c11 service nova] Enqueued Resource ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 with Priority: HIGHEST for action security_group_members [ 829.309595] env[65136]: INFO networking_nsxv3.common.synchronization [req-66e9ce0c-803c-4e20-92c1-95da177c95bf req-df7f9fb5-c03e-4fd9-8de9-a5ca3ddf8c11 service nova] Enqueued Resource ID: 3fd1ef91-b049-4b11-8c51-2639db8b0292 with Priority: HIGHEST for action port [ 829.309595] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 with Priority: HIGHEST for action security_group_rules [ 829.309712] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 with Priority: HIGHEST for action security_group_members [ 829.309810] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd1ef91-b049-4b11-8c51-2639db8b0292 with Priority: HIGHEST for action port [ 829.310949] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed7ec91e-a13b-4082-ab28-c92b4852a8c3 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.310949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.310949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.310949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.310949] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed7ec91e-a13b-4082-ab28-c92b4852a8c3',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.312317] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.312317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.312317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.312317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.312317] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.312317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.312529] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.312529] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.312589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.312622] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed7ec91e-a13b-4082-ab28-c92b4852a8c3',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.313602] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fd1ef91-b049-4b11-8c51-2639db8b0292 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.313602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fd1ef91-b049-4b11-8c51-2639db8b0292" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.313748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fd1ef91-b049-4b11-8c51-2639db8b0292" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.313798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fd1ef91-b049-4b11-8c51-2639db8b0292" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.313867] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fd1ef91-b049-4b11-8c51-2639db8b0292',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.468155] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.468320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.468390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.468644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.468819] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.468927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.468989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.469162] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.469245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.469331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.469471] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.469557] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.469615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.469792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.469920] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.470017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.470085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.470220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.470292] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.470369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.470457] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.815588] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed7ec91e-a13b-4082-ab28-c92b4852a8c3',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.817206] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.817206] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.817361] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fd1ef91-b049-4b11-8c51-2639db8b0292 with status ACTIVE [ 829.817488] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.817590] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.817656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.817860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.817945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.818143] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.818229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.818264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.818417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.818495] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.818764] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.818880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.818950] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.819642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.819750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.819888] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fd1ef91-b049-4b11-8c51-2639db8b0292 is going to be updated. [ 829.847374] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.847514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.847602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.847836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.847993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.848196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fd1ef91-b049-4b11-8c51-2639db8b0292" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.913665] env[65136]: INFO networking_nsxv3.common.synchronization [req-517e0656-f35e-4d3a-8dc0-8ee8cdd19ac1 req-4a4f1f78-d32a-4a44-8810-41e5b1f2e806 tempest-ImagesOneServerNegativeTestJSON-685255343 tempest-ImagesOneServerNegativeTestJSON-685255343-project-member] Enqueued Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 829.914475] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 829.914906] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.915103] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.915199] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.915468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.915781] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.915906] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.916024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.916253] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.916379] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.916516] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.972691] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15: rpc.has_security_group_logging(os_id): False [ 829.998207] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.998405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.998452] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.998770] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.998907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.999062] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.999197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.999264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.999439] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.999527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.999809] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.999884] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.999937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.000092] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.000172] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.000359] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.000453] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.000508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.000667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.001681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.001681] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 830.074061] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.074061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.074061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.074061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.074061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.092524] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 830.322216] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed7ec91e-a13b-4082-ab28-c92b4852a8c3',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.329868] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.330070] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-913" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.330197] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-913" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.330466] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-913" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.330719] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.330865] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.330977] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.331190] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.331326] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.331537] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 830.331639] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 830.331745] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 830.331846] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 830.331949] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 830.332071] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 830.332206] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 830.357226] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 830.357419] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 830.357568] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 830.357792] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-913" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.358155] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-5ecca372-e01d-43a9-a5a2-3e8357ff78c1 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.358333] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-5ecca372-e01d-43a9-a5a2-3e8357ff78c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.358453] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-5ecca372-e01d-43a9-a5a2-3e8357ff78c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.358872] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-5ecca372-e01d-43a9-a5a2-3e8357ff78c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.359785] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ecca372-e01d-43a9-a5a2-3e8357ff78c1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.420094] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.420475] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.420475] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.420649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.420715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.421188] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.421188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.421188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.422283] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.422283] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.422283] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b is going to be deleted. [ 830.464970] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.465227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.465227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.465435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.465538] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.465642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.825572] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.825572] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.825572] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.825572] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.825572] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.825572] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 is going to be created. [ 830.850614] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.850614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.850808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.850894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.851594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.862925] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.863298] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.863461] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.863746] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.863938] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.864168] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 5ecca372-e01d-43a9-a5a2-3e8357ff78c1 not found, creating... [ 830.864441] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.864651] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.864723] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.865388] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.865388] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.865507] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.865762] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.865843] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.865995] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.866143] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.866330] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 5ecca372-e01d-43a9-a5a2-3e8357ff78c1 is going to be created. [ 830.868443] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 in Status: UNINITIALIZED for 2s [ 830.890457] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.890721] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.890850] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.892119] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.892119] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.892119] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-5ecca372-e01d-43a9-a5a2-3e8357ff78c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.196489] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d in Status: SUCCESS [ 831.196869] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5640a309-d0fa-4870-9eee-f2caeb1f4b8d deletion is rescheduled due to dependency. [ 831.196869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5640a309-d0fa-4870-9eee-f2caeb1f4b8d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.613302] env[65136]: INFO networking_nsxv3.common.synchronization [req-517e0656-f35e-4d3a-8dc0-8ee8cdd19ac1 req-c54c77b9-f847-465c-bb86-8fb4470aa4e2 service nova] Enqueued Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_rules [ 831.613302] env[65136]: INFO networking_nsxv3.common.synchronization [req-517e0656-f35e-4d3a-8dc0-8ee8cdd19ac1 req-c54c77b9-f847-465c-bb86-8fb4470aa4e2 service nova] Enqueued Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 831.613463] env[65136]: INFO networking_nsxv3.common.synchronization [req-517e0656-f35e-4d3a-8dc0-8ee8cdd19ac1 req-c54c77b9-f847-465c-bb86-8fb4470aa4e2 service nova] Enqueued Resource ID: 5ecca372-e01d-43a9-a5a2-3e8357ff78c1 with Priority: HIGHEST for action port [ 831.613897] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_rules [ 831.614032] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 831.614135] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ecca372-e01d-43a9-a5a2-3e8357ff78c1 with Priority: HIGHEST for action port [ 831.614536] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.614659] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.614823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.614920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.615085] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.615870] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.615938] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.616891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.616891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.616891] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.616891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.616891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.616891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.616891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.616891] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.618124] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ecca372-e01d-43a9-a5a2-3e8357ff78c1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.618124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ecca372-e01d-43a9-a5a2-3e8357ff78c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.618124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ecca372-e01d-43a9-a5a2-3e8357ff78c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.618317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ecca372-e01d-43a9-a5a2-3e8357ff78c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.618317] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ecca372-e01d-43a9-a5a2-3e8357ff78c1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.106897] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 832.107218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.120047] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.120213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.122195] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ecca372-e01d-43a9-a5a2-3e8357ff78c1 with status ACTIVE [ 832.122405] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.122542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.122649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.122898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.122898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.123099] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.123202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.123267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.123407] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.123476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.123648] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.123743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.123825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.123964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.124052] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.124137] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ecca372-e01d-43a9-a5a2-3e8357ff78c1 is going to be updated. [ 832.125334] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.150105] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.150290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.150328] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.151184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.151184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.151184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ecca372-e01d-43a9-a5a2-3e8357ff78c1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.349534] env[65136]: INFO networking_nsxv3.common.synchronization [req-dd67f867-5170-4a9a-8472-6de6751b56f9 req-4b8144a8-8cb2-4fcc-b0d2-e5a14e602841 tempest-ServerRescueTestJSONUnderV235-188472497 tempest-ServerRescueTestJSONUnderV235-188472497-project-member] Enqueued Resource ID: 3d6ce766-3475-4d64-9aee-848bca959283 with Priority: HIGHEST for action security_group_members [ 832.349534] env[65136]: INFO networking_nsxv3.common.synchronization [req-dd67f867-5170-4a9a-8472-6de6751b56f9 req-4b8144a8-8cb2-4fcc-b0d2-e5a14e602841 tempest-ServerRescueTestJSONUnderV235-188472497 tempest-ServerRescueTestJSONUnderV235-188472497-project-member] Enqueued Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_members [ 832.351204] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d6ce766-3475-4d64-9aee-848bca959283 with Priority: HIGHEST for action security_group_members [ 832.351204] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_members [ 832.351204] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d6ce766-3475-4d64-9aee-848bca959283 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.351204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.351204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.351204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.351861] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.351861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.351861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.352018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.352018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.352121] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d6ce766-3475-4d64-9aee-848bca959283',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.353110] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.353266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.353340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.353518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.354175] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.354175] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.354175] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.354175] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.354175] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.354175] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.403960] env[65136]: INFO networking_nsxv3.common.synchronization [req-dd67f867-5170-4a9a-8472-6de6751b56f9 req-4b8144a8-8cb2-4fcc-b0d2-e5a14e602841 tempest-ServerRescueTestJSONUnderV235-188472497 tempest-ServerRescueTestJSONUnderV235-188472497-project-member] Enqueued Resource ID: 3d6ce766-3475-4d64-9aee-848bca959283 with Priority: HIGHEST for action security_group_rules [ 832.404153] env[65136]: INFO networking_nsxv3.common.synchronization [req-dd67f867-5170-4a9a-8472-6de6751b56f9 req-4b8144a8-8cb2-4fcc-b0d2-e5a14e602841 tempest-ServerRescueTestJSONUnderV235-188472497 tempest-ServerRescueTestJSONUnderV235-188472497-project-member] Enqueued Resource ID: 3d6ce766-3475-4d64-9aee-848bca959283 with Priority: HIGHEST for action security_group_members [ 832.404293] env[65136]: INFO networking_nsxv3.common.synchronization [req-dd67f867-5170-4a9a-8472-6de6751b56f9 req-4b8144a8-8cb2-4fcc-b0d2-e5a14e602841 tempest-ServerRescueTestJSONUnderV235-188472497 tempest-ServerRescueTestJSONUnderV235-188472497-project-member] Enqueued Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_rules [ 832.404425] env[65136]: INFO networking_nsxv3.common.synchronization [req-dd67f867-5170-4a9a-8472-6de6751b56f9 req-4b8144a8-8cb2-4fcc-b0d2-e5a14e602841 tempest-ServerRescueTestJSONUnderV235-188472497 tempest-ServerRescueTestJSONUnderV235-188472497-project-member] Enqueued Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_members [ 832.404551] env[65136]: INFO networking_nsxv3.common.synchronization [req-dd67f867-5170-4a9a-8472-6de6751b56f9 req-4b8144a8-8cb2-4fcc-b0d2-e5a14e602841 tempest-ServerRescueTestJSONUnderV235-188472497 tempest-ServerRescueTestJSONUnderV235-188472497-project-member] Enqueued Resource ID: b25b41b0-2f15-4b6a-a7f2-76add682fe92 with Priority: HIGHEST for action port [ 832.405587] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d6ce766-3475-4d64-9aee-848bca959283 with Priority: HIGHEST for action security_group_rules [ 832.405964] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_rules [ 832.405964] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b25b41b0-2f15-4b6a-a7f2-76add682fe92 with Priority: HIGHEST for action port [ 832.405964] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d6ce766-3475-4d64-9aee-848bca959283 with Priority: HIGHEST for action security_group_members [ 832.406237] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_members [ 832.406272] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d6ce766-3475-4d64-9aee-848bca959283 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.406405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.406455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.406807] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.406891] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d6ce766-3475-4d64-9aee-848bca959283',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.408191] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.408191] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.408191] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.408191] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.408191] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.409042] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-b25b41b0-2f15-4b6a-a7f2-76add682fe92 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.409163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.409211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.409640] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.412493] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b25b41b0-2f15-4b6a-a7f2-76add682fe92',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.413437] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d6ce766-3475-4d64-9aee-848bca959283 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.413437] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.413437] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.413437] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.604154] env[65136]: INFO networking_nsxv3.common.synchronization [req-e9868c32-265c-4757-956c-f0ddb7a44ca4 req-627867cd-24d6-4db6-8a79-c94009a22889 tempest-ServerRescueTestJSON-1597968343 tempest-ServerRescueTestJSON-1597968343-project-member] Enqueued Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_members [ 832.604706] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_members [ 832.605088] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-246d2702-c0f1-4486-92fb-beb4b3b1950e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.605192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.605346] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.605599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.605805] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.607809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.607887] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.608097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.608191] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.608290] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.629289] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.739883] env[65136]: INFO networking_nsxv3.common.synchronization [req-9519aaa0-abaa-46a1-af6a-ea0c9a9cb95c req-fa85468d-7dde-456e-9272-6d89c302e8cb tempest-DeleteServersTestJSON-1045367082 tempest-DeleteServersTestJSON-1045367082-project-member] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 832.740305] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 832.740620] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.740742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.740835] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.741020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.741190] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.741284] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.741339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.741517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.741726] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.741832] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.856548] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d6ce766-3475-4d64-9aee-848bca959283',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.858778] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.881856] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 in Status: SUCCESS [ 832.881856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.881856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.881856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.882130] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.882189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.882292] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.882391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.882466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.882549] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.882636] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed7ec91e-a13b-4082-ab28-c92b4852a8c3',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.919021] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d6ce766-3475-4d64-9aee-848bca959283 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.919021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.919021] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.919021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.919021] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b25b41b0-2f15-4b6a-a7f2-76add682fe92 with status ACTIVE [ 832.919021] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.919021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.919021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.919021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.919021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.919021] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.919021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.919021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.919021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.919021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.919645] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.919645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.919645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.920290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.920593] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.920833] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b25b41b0-2f15-4b6a-a7f2-76add682fe92 is going to be updated. [ 832.946746] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.946746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.946746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.946746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.946746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.946746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.105870] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.106378] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.106556] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.107023] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.107356] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.107571] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.107756] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.108035] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.108227] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.108505] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.108743] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.108945] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.109115] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.109279] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 833.109435] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.109632] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.111695] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.131982] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.132188] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 833.132323] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.132496] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.132807] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-695b5823-a209-4b45-b941-5f75415d8bff taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.132997] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-695b5823-a209-4b45-b941-5f75415d8bff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.133109] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-695b5823-a209-4b45-b941-5f75415d8bff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.133428] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-695b5823-a209-4b45-b941-5f75415d8bff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.133564] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('695b5823-a209-4b45-b941-5f75415d8bff',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.134999] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.135135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.135214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.135372] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.135454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.135542] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b is going to be created. [ 833.164562] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.164562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.164562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.164562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.164562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.179570] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: UNINITIALIZED for 2s [ 833.244509] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.360477] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d6ce766-3475-4d64-9aee-848bca959283',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.361544] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.386023] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.386023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.386023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.386023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.386230] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.386230] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.386318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.386876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.386876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.386876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.386876] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.386876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.386876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.389569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.389569] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.389569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.389569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.389569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.389569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.389569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.389569] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed7ec91e-a13b-4082-ab28-c92b4852a8c3',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.575917] env[65136]: INFO networking_nsxv3.common.synchronization [req-d88c3022-8beb-4681-a47f-3c1e7c77ec30 req-d4193247-7cde-470f-ac56-c7513170ed00 tempest-ServerRescueTestJSONUnderV235-188472497 tempest-ServerRescueTestJSONUnderV235-188472497-project-member] Enqueued Resource ID: 3d6ce766-3475-4d64-9aee-848bca959283 with Priority: HIGHEST for action security_group_members [ 833.576109] env[65136]: INFO networking_nsxv3.common.synchronization [req-d88c3022-8beb-4681-a47f-3c1e7c77ec30 req-d4193247-7cde-470f-ac56-c7513170ed00 tempest-ServerRescueTestJSONUnderV235-188472497 tempest-ServerRescueTestJSONUnderV235-188472497-project-member] Enqueued Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_members [ 833.576685] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d6ce766-3475-4d64-9aee-848bca959283 with Priority: HIGHEST for action security_group_members [ 833.576823] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_members [ 833.577183] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d6ce766-3475-4d64-9aee-848bca959283 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.577306] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.577543] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.577769] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.614171] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.626184] env[65136]: INFO networking_nsxv3.common.synchronization [req-d88c3022-8beb-4681-a47f-3c1e7c77ec30 req-d4193247-7cde-470f-ac56-c7513170ed00 tempest-ServerRescueTestJSONUnderV235-188472497 tempest-ServerRescueTestJSONUnderV235-188472497-project-member] Enqueued Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_rules [ 833.626390] env[65136]: INFO networking_nsxv3.common.synchronization [req-d88c3022-8beb-4681-a47f-3c1e7c77ec30 req-d4193247-7cde-470f-ac56-c7513170ed00 tempest-ServerRescueTestJSONUnderV235-188472497 tempest-ServerRescueTestJSONUnderV235-188472497-project-member] Enqueued Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_members [ 833.626534] env[65136]: INFO networking_nsxv3.common.synchronization [req-d88c3022-8beb-4681-a47f-3c1e7c77ec30 req-d4193247-7cde-470f-ac56-c7513170ed00 tempest-ServerRescueTestJSONUnderV235-188472497 tempest-ServerRescueTestJSONUnderV235-188472497-project-member] Enqueued Resource ID: b25b41b0-2f15-4b6a-a7f2-76add682fe92 with Priority: HIGHEST for action port [ 833.627061] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_rules [ 833.627200] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_members [ 833.627303] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b25b41b0-2f15-4b6a-a7f2-76add682fe92 with Priority: HIGHEST for action port [ 833.627796] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.627907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.628122] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.628205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.628465] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-b25b41b0-2f15-4b6a-a7f2-76add682fe92 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.628528] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.628563] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.628800] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.628866] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b25b41b0-2f15-4b6a-a7f2-76add682fe92',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.637515] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.638366] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.638366] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.638366] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.638603] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.638603] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 695b5823-a209-4b45-b941-5f75415d8bff not found, creating... [ 833.638872] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.638958] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.639091] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.639315] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.639451] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.639756] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.639879] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.639996] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.643123] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.643123] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.643123] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 695b5823-a209-4b45-b941-5f75415d8bff is going to be created. [ 833.667083] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.667305] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.667417] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.667635] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.667864] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.668219] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-695b5823-a209-4b45-b941-5f75415d8bff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.747917] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.864162] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.864360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.864499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.864749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.864967] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.865174] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d6ce766-3475-4d64-9aee-848bca959283 is going to be created. [ 833.867364] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.867514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.867631] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.867844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.867951] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.868074] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62915302-b87a-442e-90fd-bf9466c47c0f is going to be updated. [ 833.891541] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed7ec91e-a13b-4082-ab28-c92b4852a8c3: rpc.has_security_group_logging(os_id): False [ 833.901275] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.901387] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.902042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.902042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.902042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.911105] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.911341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.911426] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.911662] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.911859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.916239] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d6ce766-3475-4d64-9aee-848bca959283 in Status: UNINITIALIZED for 2s [ 833.920800] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.920998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.921105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.921476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.921598] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.921824] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.921945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.922018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.922245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.922345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.922557] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.922779] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.922862] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.923221] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.923324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.923555] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.923744] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.923847] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.924135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.924135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.924265] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 is going to be created. [ 833.926636] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: IN_PROGRESS for 2s [ 834.010411] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.010730] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.010730] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.010988] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.011095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.033966] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 in Status: IN_PROGRESS for 2s [ 834.117453] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.117619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.118596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.118596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.118596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.118596] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e is going to be updated. [ 834.130525] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b25b41b0-2f15-4b6a-a7f2-76add682fe92 with status ACTIVE [ 834.130775] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.130964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.131024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.131247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.131392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.131540] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.132667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.132667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.132667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.132667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.132667] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.132667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.132667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.132667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.133733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.133834] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b25b41b0-2f15-4b6a-a7f2-76add682fe92 is going to be updated. [ 834.162542] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.162761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.162878] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.163161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.163393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.176020] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e in Status: IN_PROGRESS for 2s [ 834.177156] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.177327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.177429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.177692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.178225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.178478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b25b41b0-2f15-4b6a-a7f2-76add682fe92" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.250403] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.250631] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.250631] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.250882] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.250989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.251124] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 834.294495] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.294697] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.294778] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.294977] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.295137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.317809] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 834.397221] env[65136]: INFO networking_nsxv3.common.synchronization [req-1546ea27-a72a-4ab6-9bc0-7a6a4dcd9218 req-30eee34e-84b2-4fbe-936b-2f936b742f53 tempest-ServersAdminTestJSON-92432023 tempest-ServersAdminTestJSON-92432023-project-member] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 834.397881] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 834.398233] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.398468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.398468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.398651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.398800] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.398906] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.398982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.399205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.399294] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.399396] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.409327] env[65136]: INFO networking_nsxv3.common.synchronization [req-9519aaa0-abaa-46a1-af6a-ea0c9a9cb95c req-d9580036-a517-4cc6-b5f2-963da9b16402 service nova] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_rules [ 834.409530] env[65136]: INFO networking_nsxv3.common.synchronization [req-9519aaa0-abaa-46a1-af6a-ea0c9a9cb95c req-d9580036-a517-4cc6-b5f2-963da9b16402 service nova] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 834.409671] env[65136]: INFO networking_nsxv3.common.synchronization [req-9519aaa0-abaa-46a1-af6a-ea0c9a9cb95c req-d9580036-a517-4cc6-b5f2-963da9b16402 service nova] Enqueued Resource ID: 695b5823-a209-4b45-b941-5f75415d8bff with Priority: HIGHEST for action port [ 834.410412] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_rules [ 834.410545] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 834.410647] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 695b5823-a209-4b45-b941-5f75415d8bff with Priority: HIGHEST for action port [ 834.411216] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.411348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.411416] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.411614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.411736] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.412989] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.412989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.412989] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-695b5823-a209-4b45-b941-5f75415d8bff taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.413495] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-695b5823-a209-4b45-b941-5f75415d8bff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.413564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-695b5823-a209-4b45-b941-5f75415d8bff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.415782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-695b5823-a209-4b45-b941-5f75415d8bff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.415782] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('695b5823-a209-4b45-b941-5f75415d8bff',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.901421] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.916337] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.916477] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.917068] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 695b5823-a209-4b45-b941-5f75415d8bff with status ACTIVE [ 834.917253] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.917368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.917447] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.917817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.917817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.917911] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.917966] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.918014] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.918167] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.918278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.918525] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.918742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.918804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.918941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.919194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.919988] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 695b5823-a209-4b45-b941-5f75415d8bff is going to be updated. [ 834.940914] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.941094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.941145] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.941350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.941488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.941648] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-695b5823-a209-4b45-b941-5f75415d8bff" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.193103] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: SUCCESS [ 835.193345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.193528] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.194161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.194161] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.194161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.194346] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.194389] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.194683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.194683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.194683] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.404576] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.516566] env[65136]: INFO networking_nsxv3.common.synchronization [req-90ccd9af-6d01-40cf-8573-7f1cd5fa7598 req-0845fc64-b362-4a07-9221-364ea6e2dd34 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 835.517231] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 835.517796] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.517976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.518061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.518403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.518465] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.518557] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.518685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.519581] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.519581] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.519581] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.697956] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.698147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.698147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.699159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.699159] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.699159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.699159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.699159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.699159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.699645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.699645] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.699645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.699645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.700055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.700055] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.700055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.700055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.700055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.700324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.700324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.700324] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.888027] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-289 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.888247] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-289" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.888371] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-289" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.888871] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-289" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.889929] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.889929] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.889929] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.889929] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.889929] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.889929] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 835.889929] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.890338] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.890338] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.890338] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 835.890338] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.890464] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.907643] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.907801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.907865] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.910020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.910020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.910020] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be updated. [ 835.911364] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.912325] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 835.912325] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.912325] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-289" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.912325] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-49984234-50cf-449a-bb18-9f380693d041 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.913145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.913145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.913145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.913145] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49984234-50cf-449a-bb18-9f380693d041',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.928907] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d6ce766-3475-4d64-9aee-848bca959283 in Status: SUCCESS [ 835.929582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.930677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.930903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.932377] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.932540] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.932615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.932797] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.932883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.932982] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d6ce766-3475-4d64-9aee-848bca959283',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.943279] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: SUCCESS [ 835.943422] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.944231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.944442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.944627] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.944745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.944866] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.944985] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.945081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.945178] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.946943] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.947093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.947167] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.949779] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.949960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.958730] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: IN_PROGRESS for 2s [ 836.021580] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.021791] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.021964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.022312] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.022436] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.022781] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.023010] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.023111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.023264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.023345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.023438] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d already deleted. [ 836.023518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.047584] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 in Status: SUCCESS [ 836.047801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.188466] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e in Status: SUCCESS [ 836.188466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.203635] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee57c421-9f97-4726-90f3-a34f9975cc5b: rpc.has_security_group_logging(os_id): False [ 836.246815] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.247045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.247045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.247273] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.247363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.247568] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.247702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.247772] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.247960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.248046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.248273] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.248395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.248470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.248654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.248744] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.248944] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.249054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.249119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.249250] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.249335] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.249421] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b is going to be created. [ 836.328604] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 836.328852] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.329033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.329256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.329436] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.329556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.329658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.329813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.329893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.329990] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.345875] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.346078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.346078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.346278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.346451] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.359889] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: IN_PROGRESS for 2s [ 836.416815] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.417246] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.417358] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.417649] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.417870] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.418067] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 49984234-50cf-449a-bb18-9f380693d041 not found, creating... [ 836.418438] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.418537] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.418728] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.419106] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.419284] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.419602] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.419786] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.419951] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.420204] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.420344] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.420489] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 49984234-50cf-449a-bb18-9f380693d041 is going to be created. [ 836.435689] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.435886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.435927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.436181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.436302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.436549] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.436660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.436707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.437358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.437358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.437358] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d6ce766-3475-4d64-9aee-848bca959283 is going to be deleted. [ 836.452786] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.469057] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.469405] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.469405] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.469691] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.469922] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.470172] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.483050] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.483050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.483050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.483355] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.483355] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.483460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.483609] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.483763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.483947] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.484116] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.484116] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.484250] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.484293] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.484391] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d6ce766-3475-4d64-9aee-848bca959283',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.835271] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.955086] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.986145] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.986331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.986380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.986680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.986818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.987070] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.987192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.987268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.987437] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.987517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.987606] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d6ce766-3475-4d64-9aee-848bca959283 already deleted. [ 836.987872] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.987872] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d6ce766-3475-4d64-9aee-848bca959283',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.988774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.989098] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.989253] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.989355] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.989424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.989585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.989706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.989744] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d6ce766-3475-4d64-9aee-848bca959283',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.175120] env[65136]: INFO networking_nsxv3.common.synchronization [req-90ccd9af-6d01-40cf-8573-7f1cd5fa7598 req-ea2ffecd-c7c2-48a0-9c7b-163430b39bb5 service nova] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_rules [ 837.175542] env[65136]: INFO networking_nsxv3.common.synchronization [req-90ccd9af-6d01-40cf-8573-7f1cd5fa7598 req-ea2ffecd-c7c2-48a0-9c7b-163430b39bb5 service nova] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 837.175542] env[65136]: INFO networking_nsxv3.common.synchronization [req-90ccd9af-6d01-40cf-8573-7f1cd5fa7598 req-ea2ffecd-c7c2-48a0-9c7b-163430b39bb5 service nova] Enqueued Resource ID: 49984234-50cf-449a-bb18-9f380693d041 with Priority: HIGHEST for action port [ 837.176102] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_rules [ 837.176374] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 837.176548] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49984234-50cf-449a-bb18-9f380693d041 with Priority: HIGHEST for action port [ 837.177009] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.177210] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.177280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.177546] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.177662] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.178693] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.178842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.178923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.179086] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.179280] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.179382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.179446] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.179595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.179723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.179804] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.185486] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-49984234-50cf-449a-bb18-9f380693d041 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.185687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.185758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.186115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.186211] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49984234-50cf-449a-bb18-9f380693d041',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.334527] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.459639] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.459639] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.459639] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.459639] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.459639] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.459639] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62915302-b87a-442e-90fd-bf9466c47c0f is going to be updated. [ 837.491318] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.491318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.491318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.491518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.491609] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.492835] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.492974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.493025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.493187] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.493266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.493447] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.493566] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.493629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.493740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.493790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.493873] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d6ce766-3475-4d64-9aee-848bca959283 already deleted. [ 837.493950] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.494178] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d6ce766-3475-4d64-9aee-848bca959283',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.506083] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: IN_PROGRESS for 2s [ 837.686418] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.692612] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49984234-50cf-449a-bb18-9f380693d041 with status ACTIVE [ 837.692846] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.693188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.693188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.693328] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.693430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.693622] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.693727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.693791] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.693927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.694013] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.697550] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.697550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.697550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.698312] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.699177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.700209] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49984234-50cf-449a-bb18-9f380693d041 is going to be updated. [ 837.701102] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.701453] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.725670] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.725897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.725897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.726192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.726670] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.726670] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.837520] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.837520] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.837703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.837901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.837991] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.838112] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 837.889435] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.889644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.889716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.890327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.890327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.902566] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 837.969500] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 837.969738] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.996644] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d6ce766-3475-4d64-9aee-848bca959283: rpc.has_security_group_logging(os_id): False [ 838.016742] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.016961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.016961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.017206] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.017287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.017524] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.017647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.017705] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.017834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.018013] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.018013] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d6ce766-3475-4d64-9aee-848bca959283 is going to be created. [ 838.040507] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/3d6ce766-3475-4d64-9aee-848bca959283], does not exist path=[/infra/domains/default/groups/3d6ce766-3475-4d64-9aee-848bca959283]."\n}' [ 838.040681] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d6ce766-3475-4d64-9aee-848bca959283 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3d6ce766-3475-4d64-9aee-848bca959283 [ 838.040785] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 838.073672] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.073891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.073958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.074153] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.074898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.075195] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.075308] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.075414] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.075539] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.075617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.075820] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.075914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.075982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.076130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.076205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.076293] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d6ce766-3475-4d64-9aee-848bca959283 is going to be created. [ 838.094958] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/3d6ce766-3475-4d64-9aee-848bca959283], does not exist path=[/infra/domains/default/groups/3d6ce766-3475-4d64-9aee-848bca959283]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3d6ce766-3475-4d64-9aee-848bca959283 [ 838.095162] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d6ce766-3475-4d64-9aee-848bca959283" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.095585] env[65136]: Traceback (most recent call last): [ 838.095585] env[65136]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 838.095585] env[65136]: return func(*args, **kwargs) [ 838.095585] env[65136]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 838.095585] env[65136]: res.raise_for_status() [ 838.095585] env[65136]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 838.095585] env[65136]: raise HTTPError(http_error_msg, response=self) [ 838.095585] env[65136]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3d6ce766-3475-4d64-9aee-848bca959283 [ 838.095585] env[65136]: During handling of the above exception, another exception occurred: [ 838.095585] env[65136]: Traceback (most recent call last): [ 838.095585] env[65136]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 838.095585] env[65136]: listener.cb(fileno) [ 838.097386] env[65136]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 838.097386] env[65136]: result = function(*args, **kwargs) [ 838.097386] env[65136]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 838.097386] env[65136]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 838.097386] env[65136]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 838.097386] env[65136]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 838.097386] env[65136]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 838.097386] env[65136]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 838.097386] env[65136]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 838.097386] env[65136]: res.raise_for_status() [ 838.097386] env[65136]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 838.097386] env[65136]: raise HTTPError(http_error_msg, response=self) [ 838.097386] env[65136]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/3d6ce766-3475-4d64-9aee-848bca959283 [ 838.097386] env[65136]: Removing descriptor: 64 [ 838.203560] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.379152] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: SUCCESS [ 838.379625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.705929] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.705929] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.705929] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.706385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.706385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.706385] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be created. [ 838.734532] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.734689] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.734733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.734920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.735131] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.745554] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: UNINITIALIZED for 2s [ 839.519170] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: SUCCESS [ 839.519461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.520361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.520361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.520454] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.520598] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.520745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.520992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.521167] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.522228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.522228] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.523300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.523947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.524198] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.525771] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.525861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.526118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.526256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.526394] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.914464] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 839.914822] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.914866] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.915100] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.915306] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.915424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.915489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.915654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.915809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.915917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.916029] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.024054] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.024212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.029736] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.418344] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.418519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.418620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.418974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.419198] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.419363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.419460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.419681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.419812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.420250] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.420250] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.420250] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.420433] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.420468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.420659] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.420806] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.420873] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.421024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.421105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.421201] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.421302] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.532075] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.761952] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 840.762293] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.762513] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.762809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.763079] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.763230] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.763336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.763792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.763908] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.764043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.764164] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.924610] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5ef8f7d-8350-4fe2-9bef-70ff70b5f141: rpc.has_security_group_logging(os_id): False [ 840.945335] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.946899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.946899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.946899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.967857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.969808] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.969808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.969808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.970140] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.970140] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.970368] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.970568] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.970641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.970804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.971251] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.971251] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.971462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.971596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.971695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.971780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.971858] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 841.036781] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.036781] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.036781] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.036781] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.036781] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.037673] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.037844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.037924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.038134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.038220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.038311] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62915302-b87a-442e-90fd-bf9466c47c0f is going to be updated. [ 841.064963] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 841.084849] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.084849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.084849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.084849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.084849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.094915] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: IN_PROGRESS for 2s [ 841.267675] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.267924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.268043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.268261] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.268460] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.268619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.268746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.268944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.269044] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.269135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.269309] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.269406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.269470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.269625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.269767] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.269860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.269933] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.270085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.270238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.270352] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.270444] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.772865] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 614443cd-8cb8-47ec-8a41-58ab513d082d: rpc.has_security_group_logging(os_id): False [ 841.795313] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.795539] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.795601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.795868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.796045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.796299] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.796631] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.796631] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.799166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.799166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.799166] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.799166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.799166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.799166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.799166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.799166] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.799166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.799166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.799166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.799166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.799166] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be created. [ 841.864334] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.864468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.864537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.864756] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.864932] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.877422] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 842.177790] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 842.178162] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 843.091445] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 843.091729] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.112163] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: SUCCESS [ 843.112163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.112163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.112296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.112514] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.112594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.112676] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.112874] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.112963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.113759] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.310422] env[65136]: INFO networking_nsxv3.common.synchronization [req-4635a45d-4261-4123-b04e-8cbda20c1e1b req-f5d78834-9de4-46af-bb52-405a579021f7 tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 with Priority: HIGHEST for action security_group_members [ 843.311746] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 with Priority: HIGHEST for action security_group_members [ 843.311857] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.311937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.312072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.312669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.312806] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.313576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.313681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.314057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.314057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.314188] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc78997-cbe5-4eed-9a43-9c7f00c61ec1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.616981] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.818088] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.818321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.818582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.818632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.818971] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.819141] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.819287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.819287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.819451] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.819560] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.819560] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 already deleted. [ 843.819797] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.824895] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-998 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.825208] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.825368] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.825686] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.825960] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.826481] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.826481] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.826571] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.826745] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.827023] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.827149] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.827256] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.827380] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.827496] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 843.827681] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.827740] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.849273] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.849501] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 843.849584] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.849781] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.850138] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-da4c6652-ff95-4f2d-bca1-32993d4490fb taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.850312] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-da4c6652-ff95-4f2d-bca1-32993d4490fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.850439] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-da4c6652-ff95-4f2d-bca1-32993d4490fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.850761] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-da4c6652-ff95-4f2d-bca1-32993d4490fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.850936] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da4c6652-ff95-4f2d-bca1-32993d4490fb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.892495] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 843.892845] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.119414] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.231139] env[65136]: INFO networking_nsxv3.common.synchronization [req-2b3ea5dd-0749-4c14-85c7-a0c30786308a req-4a52d07c-fed1-4ae7-bd53-8657c852caf1 tempest-ListServerFiltersTestJSON-1251039073 tempest-ListServerFiltersTestJSON-1251039073-project-member] Enqueued Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 844.232416] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 844.232778] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.232906] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.232963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.233242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.233408] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.233519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.233613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.233732] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.233832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.233926] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.353328] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.353679] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.353679] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.354089] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.354168] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.354280] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port da4c6652-ff95-4f2d-bca1-32993d4490fb not found, creating... [ 844.354539] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.354703] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.354826] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.355055] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.355194] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.355470] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.355622] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.355755] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.355964] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.356109] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.356249] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: da4c6652-ff95-4f2d-bca1-32993d4490fb is going to be created. [ 844.380835] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.381121] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.381262] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.381535] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.381756] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.381981] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-da4c6652-ff95-4f2d-bca1-32993d4490fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.622111] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.622381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.622381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.622558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.622641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.622853] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62915302-b87a-442e-90fd-bf9466c47c0f is going to be updated. [ 844.657482] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.659843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.659843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.659843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.659843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.668372] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: IN_PROGRESS for 2s [ 844.737012] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.110688] env[65136]: INFO networking_nsxv3.common.synchronization [req-4635a45d-4261-4123-b04e-8cbda20c1e1b req-6d5ecee6-59cd-41ab-a31a-2c71ae78d7fd service nova] Enqueued Resource ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 with Priority: HIGHEST for action security_group_rules [ 845.111030] env[65136]: INFO networking_nsxv3.common.synchronization [req-4635a45d-4261-4123-b04e-8cbda20c1e1b req-6d5ecee6-59cd-41ab-a31a-2c71ae78d7fd service nova] Enqueued Resource ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 with Priority: HIGHEST for action security_group_members [ 845.111237] env[65136]: INFO networking_nsxv3.common.synchronization [req-4635a45d-4261-4123-b04e-8cbda20c1e1b req-6d5ecee6-59cd-41ab-a31a-2c71ae78d7fd service nova] Enqueued Resource ID: da4c6652-ff95-4f2d-bca1-32993d4490fb with Priority: HIGHEST for action port [ 845.111848] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 with Priority: HIGHEST for action security_group_rules [ 845.112015] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 with Priority: HIGHEST for action security_group_members [ 845.112100] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4c6652-ff95-4f2d-bca1-32993d4490fb with Priority: HIGHEST for action port [ 845.112387] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.112514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.112583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.112786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.112870] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbc78997-cbe5-4eed-9a43-9c7f00c61ec1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.114130] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.114130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.114130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.114324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.115147] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.115147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.115147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.115147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.115147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.115147] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc78997-cbe5-4eed-9a43-9c7f00c61ec1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.117313] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-da4c6652-ff95-4f2d-bca1-32993d4490fb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.120571] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da4c6652-ff95-4f2d-bca1-32993d4490fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.120679] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da4c6652-ff95-4f2d-bca1-32993d4490fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.120920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da4c6652-ff95-4f2d-bca1-32993d4490fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.121066] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da4c6652-ff95-4f2d-bca1-32993d4490fb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.151487] env[65136]: INFO networking_nsxv3.common.synchronization [req-e3eab663-51f3-4959-b3d9-ea5690dee2df req-0cd091e9-c13b-4fee-a930-f3f3c6953462 tempest-ServerRescueTestJSONUnderV235-188472497 tempest-ServerRescueTestJSONUnderV235-188472497-project-member] Enqueued Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_members [ 845.151777] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62915302-b87a-442e-90fd-bf9466c47c0f with Priority: HIGHEST for action security_group_members [ 845.152582] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.152582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.239783] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.624909] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbc78997-cbe5-4eed-9a43-9c7f00c61ec1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.626075] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.626189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.626346] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da4c6652-ff95-4f2d-bca1-32993d4490fb with status ACTIVE [ 845.626502] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.626605] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.626747] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.626958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.627055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.627224] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.627317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.627378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.627526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.627598] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.627770] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.627860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.627920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.630019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.630179] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.630328] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da4c6652-ff95-4f2d-bca1-32993d4490fb is going to be updated. [ 845.658724] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.658922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.659094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.659287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.659471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.659690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da4c6652-ff95-4f2d-bca1-32993d4490fb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.742252] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.742501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.742501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.742753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.742850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.742919] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b is going to be updated. [ 845.782359] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.782636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.782636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.783174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.783174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.801012] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: IN_PROGRESS for 2s [ 846.132649] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbc78997-cbe5-4eed-9a43-9c7f00c61ec1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.637603] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.637999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.638070] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.638288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.638382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.638513] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 is going to be created. [ 846.676391] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.676672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.676816] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.677127] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.677339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.680649] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: SUCCESS [ 846.680946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.681436] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.681681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.682036] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.682217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.682321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.682557] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.682673] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.682909] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.683054] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-62915302-b87a-442e-90fd-bf9466c47c0f taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.683230] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.683435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.683503] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.683675] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.683820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.683914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.684130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.684250] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.684376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.684518] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.686018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.686554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.686554] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.686762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.686762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.687081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.687285] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.687451] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.691035] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 in Status: UNINITIALIZED for 2s [ 847.190301] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62915302-b87a-442e-90fd-bf9466c47c0f: rpc.has_security_group_logging(os_id): False [ 847.193431] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.193580] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.193645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.193861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.213325] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.213425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.219491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.219861] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.220016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.220107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.220340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.220432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.220531] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62915302-b87a-442e-90fd-bf9466c47c0f is going to be updated. [ 847.223385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.223656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.223788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.224159] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.224300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.224384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.224703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.224868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.225124] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.225317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.225762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.225762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.225762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.225959] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.226145] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.226201] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.226382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.226482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.226624] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62915302-b87a-442e-90fd-bf9466c47c0f is going to be updated. [ 847.280383] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.280587] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.280631] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.280827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.280973] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.307322] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: IN_PROGRESS for 2s [ 847.346059] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.346059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.346059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.346059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.346059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.384631] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: IN_PROGRESS for 2s [ 847.813038] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: SUCCESS [ 847.813330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.956172] env[65136]: INFO networking_nsxv3.common.synchronization [req-01b427b4-4724-4648-b90b-149e216c6222 req-4cd17e89-c9db-46fe-a505-79f433b3d56f tempest-ImagesOneServerNegativeTestJSON-685255343 tempest-ImagesOneServerNegativeTestJSON-685255343-project-member] Enqueued Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 847.956756] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGHEST for action security_group_members [ 847.958317] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.958317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.958317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.958317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.958317] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.958317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.958317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.958317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.958317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.958317] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.429873] env[65136]: INFO networking_nsxv3.common.synchronization [req-409045b1-417c-4542-bd6b-23d5b41aee19 req-e2218896-a5ba-402d-9254-6a2c42966882 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 with Priority: HIGHEST for action security_group_members [ 848.430061] env[65136]: INFO networking_nsxv3.common.synchronization [req-409045b1-417c-4542-bd6b-23d5b41aee19 req-e2218896-a5ba-402d-9254-6a2c42966882 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 848.431050] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 with Priority: HIGHEST for action security_group_members [ 848.431050] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 848.431050] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3eebaf-da3a-488c-83dd-470138abdfc8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.431225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.431225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.431538] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.431761] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.431877] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.431942] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.432126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.432214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.432312] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.433207] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.433318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.433385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.433541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.433677] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.433795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.433834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.433956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.434068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.434161] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.461236] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.461456] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.461456] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.461683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.486537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.486537] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.486537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.486732] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.486848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.486893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.486946] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b is going to be updated. [ 848.491342] env[65136]: INFO networking_nsxv3.common.synchronization [req-409045b1-417c-4542-bd6b-23d5b41aee19 req-e2218896-a5ba-402d-9254-6a2c42966882 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_rules [ 848.491658] env[65136]: INFO networking_nsxv3.common.synchronization [req-409045b1-417c-4542-bd6b-23d5b41aee19 req-e2218896-a5ba-402d-9254-6a2c42966882 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 848.491719] env[65136]: INFO networking_nsxv3.common.synchronization [req-409045b1-417c-4542-bd6b-23d5b41aee19 req-e2218896-a5ba-402d-9254-6a2c42966882 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 with Priority: HIGHEST for action security_group_rules [ 848.491827] env[65136]: INFO networking_nsxv3.common.synchronization [req-409045b1-417c-4542-bd6b-23d5b41aee19 req-e2218896-a5ba-402d-9254-6a2c42966882 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 with Priority: HIGHEST for action security_group_members [ 848.491949] env[65136]: INFO networking_nsxv3.common.synchronization [req-409045b1-417c-4542-bd6b-23d5b41aee19 req-e2218896-a5ba-402d-9254-6a2c42966882 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 49984234-50cf-449a-bb18-9f380693d041 with Priority: HIGHEST for action port [ 848.492870] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_rules [ 848.492870] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 with Priority: HIGHEST for action security_group_rules [ 848.492870] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49984234-50cf-449a-bb18-9f380693d041 with Priority: HIGHEST for action port [ 848.493360] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 848.493360] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 with Priority: HIGHEST for action security_group_members [ 848.493513] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.493653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.493833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.494464] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.494703] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.496673] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac3eebaf-da3a-488c-83dd-470138abdfc8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.496673] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.496673] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.497091] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.497091] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.498238] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-49984234-50cf-449a-bb18-9f380693d041 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.498367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.498505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.498618] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.498735] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49984234-50cf-449a-bb18-9f380693d041',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.499516] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.499671] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.502467] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3eebaf-da3a-488c-83dd-470138abdfc8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.502467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.516950] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.516950] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.516950] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.517236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.517236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.532471] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: IN_PROGRESS for 2s [ 848.701931] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 in Status: SUCCESS [ 848.702175] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.702359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.702598] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.702787] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.702906] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.702974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.703135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.703217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.703301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.703392] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbc78997-cbe5-4eed-9a43-9c7f00c61ec1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.936162] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.937178] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.006467] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49984234-50cf-449a-bb18-9f380693d041 with status ACTIVE [ 849.006830] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.007021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.007087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.007272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.007412] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.007568] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.007703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.007703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.007903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.007903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.008095] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.008554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.008951] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.009229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.009315] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.009411] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49984234-50cf-449a-bb18-9f380693d041 is going to be updated. [ 849.010869] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3eebaf-da3a-488c-83dd-470138abdfc8 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.010993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.011205] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.011293] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.039087] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.039403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.039403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.039576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.039678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.040993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.059479] env[65136]: INFO networking_nsxv3.common.synchronization [req-d81e5c0a-b8f7-4cc2-a8f8-85e609a451c1 req-2d39388b-b110-443d-aea0-5a843ee8faf1 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 with Priority: HIGHEST for action security_group_members [ 849.059699] env[65136]: INFO networking_nsxv3.common.synchronization [req-d81e5c0a-b8f7-4cc2-a8f8-85e609a451c1 req-2d39388b-b110-443d-aea0-5a843ee8faf1 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 849.059915] env[65136]: INFO networking_nsxv3.common.synchronization [req-d81e5c0a-b8f7-4cc2-a8f8-85e609a451c1 req-2d39388b-b110-443d-aea0-5a843ee8faf1 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e with Priority: HIGHEST for action security_group_members [ 849.060769] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 with Priority: HIGHEST for action security_group_members [ 849.061014] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 849.061208] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e with Priority: HIGHEST for action security_group_members [ 849.061649] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3eebaf-da3a-488c-83dd-470138abdfc8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.061762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.062165] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.062301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.062612] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34f355b-9e16-4e39-9a04-e9b1d96e578e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.062792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.062915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.063281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.063529] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.063702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.063809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.064168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.064328] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.064442] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d34f355b-9e16-4e39-9a04-e9b1d96e578e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.124507] env[65136]: INFO networking_nsxv3.common.synchronization [req-d81e5c0a-b8f7-4cc2-a8f8-85e609a451c1 req-2d39388b-b110-443d-aea0-5a843ee8faf1 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_rules [ 849.124840] env[65136]: INFO networking_nsxv3.common.synchronization [req-d81e5c0a-b8f7-4cc2-a8f8-85e609a451c1 req-2d39388b-b110-443d-aea0-5a843ee8faf1 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 849.125015] env[65136]: INFO networking_nsxv3.common.synchronization [req-d81e5c0a-b8f7-4cc2-a8f8-85e609a451c1 req-2d39388b-b110-443d-aea0-5a843ee8faf1 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 with Priority: HIGHEST for action security_group_rules [ 849.125156] env[65136]: INFO networking_nsxv3.common.synchronization [req-d81e5c0a-b8f7-4cc2-a8f8-85e609a451c1 req-2d39388b-b110-443d-aea0-5a843ee8faf1 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 with Priority: HIGHEST for action security_group_members [ 849.125529] env[65136]: INFO networking_nsxv3.common.synchronization [req-d81e5c0a-b8f7-4cc2-a8f8-85e609a451c1 req-2d39388b-b110-443d-aea0-5a843ee8faf1 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e with Priority: HIGHEST for action security_group_rules [ 849.125717] env[65136]: INFO networking_nsxv3.common.synchronization [req-d81e5c0a-b8f7-4cc2-a8f8-85e609a451c1 req-2d39388b-b110-443d-aea0-5a843ee8faf1 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e with Priority: HIGHEST for action security_group_members [ 849.125887] env[65136]: INFO networking_nsxv3.common.synchronization [req-d81e5c0a-b8f7-4cc2-a8f8-85e609a451c1 req-2d39388b-b110-443d-aea0-5a843ee8faf1 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 49984234-50cf-449a-bb18-9f380693d041 with Priority: HIGHEST for action port [ 849.126657] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_rules [ 849.126705] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 with Priority: HIGHEST for action security_group_rules [ 849.126794] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e with Priority: HIGHEST for action security_group_members [ 849.126917] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49984234-50cf-449a-bb18-9f380693d041 with Priority: HIGHEST for action port [ 849.127038] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e with Priority: HIGHEST for action security_group_rules [ 849.127200] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 849.127200] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 with Priority: HIGHEST for action security_group_members [ 849.128130] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.128130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.128130] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac3eebaf-da3a-488c-83dd-470138abdfc8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.128130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.128351] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34f355b-9e16-4e39-9a04-e9b1d96e578e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.128432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.128808] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-49984234-50cf-449a-bb18-9f380693d041 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.128968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.129047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.129276] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.129358] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49984234-50cf-449a-bb18-9f380693d041',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.130658] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d34f355b-9e16-4e39-9a04-e9b1d96e578e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.130795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.130852] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.131245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.131245] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d34f355b-9e16-4e39-9a04-e9b1d96e578e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.132429] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.132541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.133019] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3eebaf-da3a-488c-83dd-470138abdfc8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.133019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.205788] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbc78997-cbe5-4eed-9a43-9c7f00c61ec1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.318493] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: SUCCESS [ 849.318716] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62915302-b87a-442e-90fd-bf9466c47c0f deletion is rescheduled due to dependency. [ 849.318893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.401311] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62915302-b87a-442e-90fd-bf9466c47c0f in Status: SUCCESS [ 849.401571] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.401776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.402022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.402135] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62915302-b87a-442e-90fd-bf9466c47c0f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.439147] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.440852] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.568708] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d34f355b-9e16-4e39-9a04-e9b1d96e578e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.635290] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34f355b-9e16-4e39-9a04-e9b1d96e578e taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.635290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.635514] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 49984234-50cf-449a-bb18-9f380693d041 with status ACTIVE [ 849.635676] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.635782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.635847] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.636161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.636328] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.636631] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.636631] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.638078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.638078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.638078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.638078] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.638078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.638078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.638078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.638078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.638078] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 49984234-50cf-449a-bb18-9f380693d041 is going to be updated. [ 849.668123] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.668123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.668123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.668123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.668123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.669476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49984234-50cf-449a-bb18-9f380693d041" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.708339] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbc78997-cbe5-4eed-9a43-9c7f00c61ec1: rpc.has_security_group_logging(os_id): False [ 849.737635] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.737882] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.737970] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.738273] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.738413] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.738778] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.738908] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.738993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.739225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.739324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.739436] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 is going to be created. [ 849.813879] env[65136]: INFO networking_nsxv3.common.synchronization [req-22acd0b3-9a86-432e-b61b-65a69df0ead4 req-d33410de-628c-4301-9be1-8ac0e195a3c4 tempest-InstanceActionsTestJSON-1152952087 tempest-InstanceActionsTestJSON-1152952087-project-member] Enqueued Resource ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 with Priority: HIGHEST for action security_group_members [ 849.814229] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 with Priority: HIGHEST for action security_group_members [ 849.814555] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.814677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.814728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.815171] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.815171] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.815321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.815321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.815489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.815570] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.815713] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed7ec91e-a13b-4082-ab28-c92b4852a8c3',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.895267] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.895267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.895267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.895267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.895267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.913231] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 in Status: IN_PROGRESS for 2s [ 849.943104] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.943502] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.943502] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.943642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.943724] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.943824] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62915302-b87a-442e-90fd-bf9466c47c0f is going to be deleted. [ 849.945106] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.945246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.945318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.945486] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.945571] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.945700] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 is going to be created. [ 849.947129] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.947295] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.947375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.947555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.947640] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.947733] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 849.994994] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.995253] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.995253] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.995519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.995705] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.018520] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.018817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.018884] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.019150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.019300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.026427] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 in Status: UNINITIALIZED for 2s [ 850.029984] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 850.046788] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.047015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.047106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.047468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.047574] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.047734] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62915302-b87a-442e-90fd-bf9466c47c0f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.071361] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d34f355b-9e16-4e39-9a04-e9b1d96e578e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.319055] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.319055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.319055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.319055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.394770] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.395096] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.395209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.395307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.395462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.395557] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.395627] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 is going to be updated. [ 850.450975] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.451195] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.451195] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.451444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.451636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.464696] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 in Status: IN_PROGRESS for 2s [ 850.543872] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee57c421-9f97-4726-90f3-a34f9975cc5b in Status: SUCCESS [ 850.543872] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b deletion is rescheduled due to dependency. [ 850.543872] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.575100] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.575268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.575268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.575427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.575515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.575616] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e is going to be created. [ 850.621188] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.621188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.621188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.621188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.621188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.632690] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e in Status: UNINITIALIZED for 2s [ 851.936082] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 in Status: SUCCESS [ 851.936400] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.042637] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 in Status: SUCCESS [ 852.042637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.043189] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 852.043361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.043583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.043813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.044016] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.044145] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.044198] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.044355] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.044578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.044681] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.045531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.045707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.047106] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.047106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.047106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.047106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.047106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.047106] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.478279] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 in Status: SUCCESS [ 852.478509] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 deletion is rescheduled due to dependency. [ 852.478648] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.549834] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.553737] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.646779] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e in Status: SUCCESS [ 852.647200] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.647435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.647670] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.647887] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.648048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.648142] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.648361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.648496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.648633] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d34f355b-9e16-4e39-9a04-e9b1d96e578e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.056870] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.057700] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.155413] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d34f355b-9e16-4e39-9a04-e9b1d96e578e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.561215] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.561215] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.561215] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.563541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.563541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.563541] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 853.564760] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.564903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.564985] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.568765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.568917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.569069] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 is going to be updated. [ 853.613645] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.614567] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.614567] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.614567] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.614567] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.617870] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.618340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.618340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.618500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.618698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.634953] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 853.634953] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 in Status: IN_PROGRESS for 2s [ 853.659554] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d34f355b-9e16-4e39-9a04-e9b1d96e578e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.162560] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.162943] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.162943] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.163209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.163345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.163483] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e is going to be updated. [ 854.286855] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.287147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.287147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.287287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.287513] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.324832] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e in Status: IN_PROGRESS for 2s [ 854.817647] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 854.817759] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=12 [ 855.650041] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 855.650041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.650041] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 in Status: SUCCESS [ 855.650989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.651245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.651486] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.651726] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.651890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.651954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.653246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.653346] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.653449] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.653596] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.654555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.655524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.655524] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.655524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.655524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.655524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.655524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.655524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.656128] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.656814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.659564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.659564] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.659564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.659564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.659564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.659564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.659564] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.659564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.659564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.659564] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.659564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.659564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.659564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.659564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.659564] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.158805] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.158957] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.161379] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.163119] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.164885] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.338160] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e in Status: SUCCESS [ 856.338375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.338559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.338850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.339064] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.339185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.339256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.339405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.339481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.339562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.339655] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d34f355b-9e16-4e39-9a04-e9b1d96e578e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.666010] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.667094] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac3eebaf-da3a-488c-83dd-470138abdfc8: rpc.has_security_group_logging(os_id): False [ 856.668143] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.688208] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.688208] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.688208] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.688208] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.688208] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.688208] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.688208] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.688208] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.688208] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.688208] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.688208] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 is going to be created. [ 856.749703] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.749810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.749871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.750107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.750278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.762809] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 in Status: IN_PROGRESS for 2s [ 856.842480] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d34f355b-9e16-4e39-9a04-e9b1d96e578e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.169736] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.169994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.170088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.170440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.170587] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.170844] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 857.172246] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.172359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.172505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.172669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.172793] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.172867] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 is going to be updated. [ 857.210114] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.210274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.210363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.210611] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.211220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.213077] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.215347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.215347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.215347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.215347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.230107] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 857.231789] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 in Status: IN_PROGRESS for 2s [ 857.265099] env[65136]: INFO networking_nsxv3.common.synchronization [req-79ca9d56-a488-41ee-a0df-e4669b378a63 req-451fdb89-d4cf-425b-935f-d920a2d312a4 tempest-ImagesTestJSON-1051903205 tempest-ImagesTestJSON-1051903205-project-member] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 857.265690] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 857.266018] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.266144] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.266228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.266419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.266577] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.266722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.266722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.266870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.267029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.267086] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.349019] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d34f355b-9e16-4e39-9a04-e9b1d96e578e: rpc.has_security_group_logging(os_id): False [ 857.369828] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.370318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.370431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.370706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.370837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.371167] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.371304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.371396] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.371595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.371701] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.371824] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e is going to be created. [ 857.439759] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.440021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.440142] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.440330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.440455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.453801] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e in Status: IN_PROGRESS for 2s [ 857.770577] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.771030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.771030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.771030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.794032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.794032] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.794032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.794032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.794032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.794032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.794032] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 857.810574] env[65136]: INFO networking_nsxv3.common.synchronization [req-456e79f4-1fbe-48f3-8fe5-3ee1e44b683b req-50808372-a072-41fd-b4ef-abfe0e760474 tempest-ServerAddressesTestJSON-1604587442 tempest-ServerAddressesTestJSON-1604587442-project-member] Enqueued Resource ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 with Priority: HIGHEST for action security_group_members [ 857.811287] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 with Priority: HIGHEST for action security_group_members [ 857.811702] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.811917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.811917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.812243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.812456] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.812597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.812937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.812937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.813046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.813090] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a503f8a3-35c3-4780-8cb3-fb17a0c4a452',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.826025] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.826025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.826025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.826025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.826025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.836292] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 858.166056] env[65136]: INFO networking_nsxv3.common.synchronization [None req-1711eb71-2b2f-4c64-903f-34762a75b9ac None None] Enqueued Resource ID: 7e8cf24a-73d4-445c-a5e2-b5a17b4a66e2 with Priority: HIGHEST for action port [ 858.167084] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e8cf24a-73d4-445c-a5e2-b5a17b4a66e2 with Priority: HIGHEST for action port [ 858.167669] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e8cf24a-73d4-445c-a5e2-b5a17b4a66e2 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.167842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e8cf24a-73d4-445c-a5e2-b5a17b4a66e2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.167971] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e8cf24a-73d4-445c-a5e2-b5a17b4a66e2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.168302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e8cf24a-73d4-445c-a5e2-b5a17b4a66e2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.168475] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e8cf24a-73d4-445c-a5e2-b5a17b4a66e2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.183787] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-229 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.184374] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-229" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.184574] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-229" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.184939] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-229" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.185317] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.185572] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.185875] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.186092] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.186300] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.186596] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.186842] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 858.187085] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 858.187260] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 858.187541] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.187666] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 858.187807] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 858.209465] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 858.209625] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 858.209800] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 858.209995] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-229" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.210333] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-02347e5e-4d4e-45db-9976-b283a56695e9 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.210505] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-02347e5e-4d4e-45db-9976-b283a56695e9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.210646] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-02347e5e-4d4e-45db-9976-b283a56695e9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.210970] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-02347e5e-4d4e-45db-9976-b283a56695e9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.211211] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02347e5e-4d4e-45db-9976-b283a56695e9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.315515] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.315688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.315752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.316190] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.316190] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.316390] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.316470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.316470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.316674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.316744] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.316848] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 already deleted. [ 858.316915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.672120] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e8cf24a-73d4-445c-a5e2-b5a17b4a66e2 [ 858.672631] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.673464] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.673656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.674063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.674649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.674649] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e8cf24a-73d4-445c-a5e2-b5a17b4a66e2 already deleted. [ 858.674649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e8cf24a-73d4-445c-a5e2-b5a17b4a66e2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.715586] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.715908] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.716098] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.716388] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.716583] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.716767] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 02347e5e-4d4e-45db-9976-b283a56695e9 not found, creating... [ 858.717051] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.717224] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.717339] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.717552] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.717685] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.717972] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.721167] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.721167] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.721167] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.721167] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.721167] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 02347e5e-4d4e-45db-9976-b283a56695e9 is going to be created. [ 858.743500] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.743727] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.743856] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.744174] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.744409] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.744639] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-02347e5e-4d4e-45db-9976-b283a56695e9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.779372] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 in Status: SUCCESS [ 858.779687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.779949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.784019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.784019] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.243707] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 859.243788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.246038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.246038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.246038] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.246038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.246038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.246038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.246038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.246038] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.246897] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 in Status: SUCCESS [ 859.248550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.248550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.248550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.248550] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.248550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.248550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.248550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.248550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.248550] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.283104] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3eebaf-da3a-488c-83dd-470138abdfc8 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.283357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.467780] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e in Status: SUCCESS [ 859.467780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.538046] env[65136]: INFO networking_nsxv3.common.synchronization [req-456e79f4-1fbe-48f3-8fe5-3ee1e44b683b req-434a0620-af74-464b-bc3e-850acd498ae1 service nova] Enqueued Resource ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 with Priority: HIGHEST for action security_group_rules [ 859.538261] env[65136]: INFO networking_nsxv3.common.synchronization [req-456e79f4-1fbe-48f3-8fe5-3ee1e44b683b req-434a0620-af74-464b-bc3e-850acd498ae1 service nova] Enqueued Resource ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 with Priority: HIGHEST for action security_group_members [ 859.538400] env[65136]: INFO networking_nsxv3.common.synchronization [req-456e79f4-1fbe-48f3-8fe5-3ee1e44b683b req-434a0620-af74-464b-bc3e-850acd498ae1 service nova] Enqueued Resource ID: 02347e5e-4d4e-45db-9976-b283a56695e9 with Priority: HIGHEST for action port [ 859.538980] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 with Priority: HIGHEST for action security_group_rules [ 859.540162] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 with Priority: HIGHEST for action security_group_members [ 859.543448] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02347e5e-4d4e-45db-9976-b283a56695e9 with Priority: HIGHEST for action port [ 859.543448] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a503f8a3-35c3-4780-8cb3-fb17a0c4a452 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.543448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.543448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.543448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.543448] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a503f8a3-35c3-4780-8cb3-fb17a0c4a452',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.543448] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.543448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.543448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.543448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.543448] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.543448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.543448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.543448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.543448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.543448] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a503f8a3-35c3-4780-8cb3-fb17a0c4a452',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.546509] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-02347e5e-4d4e-45db-9976-b283a56695e9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.546509] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02347e5e-4d4e-45db-9976-b283a56695e9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.546509] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02347e5e-4d4e-45db-9976-b283a56695e9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.546509] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02347e5e-4d4e-45db-9976-b283a56695e9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.546509] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02347e5e-4d4e-45db-9976-b283a56695e9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.749931] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.751320] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.846415] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 859.846415] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 deletion is rescheduled due to dependency. [ 859.846767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.047315] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.047711] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.047711] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a503f8a3-35c3-4780-8cb3-fb17a0c4a452',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.048640] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02347e5e-4d4e-45db-9976-b283a56695e9 with status ACTIVE [ 860.048836] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.048982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.049067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.049255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.049351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.049528] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.049621] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.049681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.050152] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.050152] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.050450] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.050629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.050629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.050703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.050775] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.050844] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02347e5e-4d4e-45db-9976-b283a56695e9 is going to be updated. [ 860.071862] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.072137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.072203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.072490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.073363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.073599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02347e5e-4d4e-45db-9976-b283a56695e9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.252774] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.253927] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.540916] env[65136]: INFO networking_nsxv3.common.synchronization [req-78499724-d530-4ee4-9e25-6c67d69de540 req-494f9e1a-8ea5-4347-b320-d2cfd5230cf6 tempest-MultipleCreateTestJSON-1748696551 tempest-MultipleCreateTestJSON-1748696551-project-member] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 860.541632] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 860.541990] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.542099] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.542154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.542734] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.543139] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.543139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.543139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.543638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.543638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.543638] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.552822] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a503f8a3-35c3-4780-8cb3-fb17a0c4a452',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.613978] env[65136]: INFO networking_nsxv3.common.synchronization [None req-3e5ae741-6c25-449f-9dee-bfe516699245 None None] Enqueued Resource ID: fb34f22b-0b9d-4b1c-b323-abb57800b6fa with Priority: HIGHEST for action port [ 860.614843] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb34f22b-0b9d-4b1c-b323-abb57800b6fa with Priority: HIGHEST for action port [ 860.617104] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb34f22b-0b9d-4b1c-b323-abb57800b6fa taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.617104] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb34f22b-0b9d-4b1c-b323-abb57800b6fa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.617104] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb34f22b-0b9d-4b1c-b323-abb57800b6fa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.617104] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb34f22b-0b9d-4b1c-b323-abb57800b6fa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.617104] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb34f22b-0b9d-4b1c-b323-abb57800b6fa',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.758175] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.758337] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.758431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.758864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.758948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.759072] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 860.760691] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.760691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.761040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.761040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.761040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.761151] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 is going to be updated. [ 860.799280] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.799280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.799450] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.799578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.799696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.805026] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.805026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.805026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.805026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.805026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.810550] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 in Status: IN_PROGRESS for 2s [ 860.811408] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 860.925883] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.926287] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.926287] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.926544] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.926800] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.927260] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.927260] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.927451] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.927552] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.927765] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.927878] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 860.927988] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 860.928112] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 860.928221] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.928325] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 860.928454] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 860.947292] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 860.947530] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 860.947671] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 860.947873] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.948361] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-8c4fad43-89b4-4eac-a07d-34ce0eef9d5c taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.948548] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-8c4fad43-89b4-4eac-a07d-34ce0eef9d5c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.948671] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-8c4fad43-89b4-4eac-a07d-34ce0eef9d5c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.949091] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-8c4fad43-89b4-4eac-a07d-34ce0eef9d5c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.949237] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c4fad43-89b4-4eac-a07d-34ce0eef9d5c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.046315] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.046489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.046562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.046791] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.046883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.047089] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.047188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.047252] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.047399] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.047474] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.047589] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be deleted. [ 861.055299] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.055435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.055531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.055691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.055773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.055868] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 is going to be created. [ 861.080383] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.080531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.080625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.081045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.081216] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.082795] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.082924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.082968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.083153] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.083237] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.083332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.091114] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 in Status: UNINITIALIZED for 2s [ 861.123079] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb34f22b-0b9d-4b1c-b323-abb57800b6fa [ 861.123356] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.123468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.123538] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.123754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.123838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.123935] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb34f22b-0b9d-4b1c-b323-abb57800b6fa already deleted. [ 861.124088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb34f22b-0b9d-4b1c-b323-abb57800b6fa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.452547] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.452547] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.452547] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.452547] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.452848] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.453033] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 8c4fad43-89b4-4eac-a07d-34ce0eef9d5c not found, creating... [ 861.453295] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.453517] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.453581] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.453808] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.454035] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.454363] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.454505] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.454621] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.454832] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.455251] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.455251] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 8c4fad43-89b4-4eac-a07d-34ce0eef9d5c is going to be created. [ 861.483233] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.483495] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.484138] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.484138] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.484362] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.484617] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-8c4fad43-89b4-4eac-a07d-34ce0eef9d5c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.136445] env[65136]: INFO networking_nsxv3.common.synchronization [None req-98e41e2c-5010-4b29-8656-ded2c8fd1c4c tempest-ServerActionsTestJSON-513195432 tempest-ServerActionsTestJSON-513195432-project-member] Enqueued Resource ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e with Priority: HIGHEST for action security_group_rules [ 862.137058] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e with Priority: HIGHEST for action security_group_rules [ 862.137403] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c51c2cd-9219-40af-b979-dfebe3666f2e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.137553] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.137601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.138077] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.138159] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c51c2cd-9219-40af-b979-dfebe3666f2e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.249274] env[65136]: INFO networking_nsxv3.common.synchronization [req-78499724-d530-4ee4-9e25-6c67d69de540 req-e0b1e3fe-bf77-4ba1-99af-c9cee8e0a45c service nova] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_rules [ 862.249676] env[65136]: INFO networking_nsxv3.common.synchronization [req-78499724-d530-4ee4-9e25-6c67d69de540 req-e0b1e3fe-bf77-4ba1-99af-c9cee8e0a45c service nova] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 862.249971] env[65136]: INFO networking_nsxv3.common.synchronization [req-78499724-d530-4ee4-9e25-6c67d69de540 req-e0b1e3fe-bf77-4ba1-99af-c9cee8e0a45c service nova] Enqueued Resource ID: 8c4fad43-89b4-4eac-a07d-34ce0eef9d5c with Priority: HIGHEST for action port [ 862.250989] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_rules [ 862.251290] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 862.251590] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c4fad43-89b4-4eac-a07d-34ce0eef9d5c with Priority: HIGHEST for action port [ 862.252351] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.253176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.253176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.253176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.253176] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.254871] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.255625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.255625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.255625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.255844] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.255960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.256099] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.256397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.256580] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.256755] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.259644] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c4fad43-89b4-4eac-a07d-34ce0eef9d5c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.259823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c4fad43-89b4-4eac-a07d-34ce0eef9d5c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.259924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c4fad43-89b4-4eac-a07d-34ce0eef9d5c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.260211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c4fad43-89b4-4eac-a07d-34ce0eef9d5c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.260322] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c4fad43-89b4-4eac-a07d-34ce0eef9d5c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.265400] env[65136]: INFO networking_nsxv3.common.synchronization [None req-f0169ccf-70f7-4e71-984b-cb4941764b98 tempest-ServerActionsTestJSON-513195432 tempest-ServerActionsTestJSON-513195432-project-member] Enqueued Resource ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e with Priority: HIGHEST for action security_group_rules [ 862.266620] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e with Priority: HIGHEST for action security_group_rules [ 862.267214] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c51c2cd-9219-40af-b979-dfebe3666f2e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.267540] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.665443] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.665443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.665443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.665443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.665443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.665443] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e already deleted. [ 862.665443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.665443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.665443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.665443] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c51c2cd-9219-40af-b979-dfebe3666f2e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.766581] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.766581] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.766581] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.767524] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c4fad43-89b4-4eac-a07d-34ce0eef9d5c with status ACTIVE [ 862.767709] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.767827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.767904] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.768162] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.768255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.768426] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.768516] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.768568] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.768727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.768844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.769031] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.770367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.770367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.770367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.770367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.770367] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c4fad43-89b4-4eac-a07d-34ce0eef9d5c is going to be updated. [ 862.807535] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.807672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.807758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.807962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.808150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.808275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c4fad43-89b4-4eac-a07d-34ce0eef9d5c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.829178] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 in Status: SUCCESS [ 862.829402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.829581] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.829835] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.830047] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.830163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.830226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.831430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.831430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.831430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.831430] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.832369] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 862.832623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.832736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.833407] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.833407] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.833407] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.833407] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.833407] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.833690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.833690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.833690] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.833848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.833848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.833979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.834205] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.834258] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.834293] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.834425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.834501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.834585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.834673] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.112109] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 in Status: SUCCESS [ 863.112309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.112472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.112789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.113013] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.113144] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.113205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.113363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.113442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.113528] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.113624] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a503f8a3-35c3-4780-8cb3-fb17a0c4a452',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.191833] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.192188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.192188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.192348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.192449] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.192598] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e already deleted. [ 863.192709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.268494] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.336408] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.337443] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 614443cd-8cb8-47ec-8a41-58ab513d082d: rpc.has_security_group_logging(os_id): False [ 863.356249] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.356478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.356478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.356702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.356823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.357086] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.357191] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.357254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.357410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.357476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.357676] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.357770] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.357834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.357970] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.358093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.358235] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.358327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.358388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.358525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.358597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.358680] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 863.423947] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.424124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.424330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.424463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.424614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.438490] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 863.618243] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.618243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.618243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.618243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.618930] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.618930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.619132] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.619199] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.619288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.619427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.619578] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.619712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.619886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.620151] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.620151] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.620706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.620706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.620706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.620706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.620706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.620706] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a503f8a3-35c3-4780-8cb3-fb17a0c4a452',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.774380] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.774380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.774586] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.774960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.774960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.774960] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be created. [ 863.802407] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.802561] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.802607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.802824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.802961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.815269] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: UNINITIALIZED for 2s [ 863.840047] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac3eebaf-da3a-488c-83dd-470138abdfc8: rpc.has_security_group_logging(os_id): False [ 863.863798] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.864028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.864028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.864227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.864316] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.864537] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.864627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.864689] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.865262] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.865262] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.865262] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 is going to be updated. [ 863.948249] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.948406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.948478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.948695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.948881] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.965016] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 in Status: IN_PROGRESS for 2s [ 864.123780] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a503f8a3-35c3-4780-8cb3-fb17a0c4a452: rpc.has_security_group_logging(os_id): False [ 864.150958] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.151148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.151422] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.151624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.151716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.151912] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.152077] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.152241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.152439] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.152543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.152749] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.152843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.152903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.153060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.153137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.153344] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.153457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.153530] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.153674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.153751] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.153846] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 is going to be created. [ 864.250912] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.250912] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.251431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.251431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.251657] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.265682] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 in Status: IN_PROGRESS for 2s [ 865.468610] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 865.468610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.468610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.468610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.469069] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.827895] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: SUCCESS [ 865.828165] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.828339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.828555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.828774] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.828901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.828974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.829203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.829287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.829378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.829474] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.971501] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.971666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.971767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.972099] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.972286] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.972403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.972478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.972629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.972735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.972825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.972927] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.979290] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 in Status: SUCCESS [ 865.979523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.280187] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 in Status: SUCCESS [ 866.280460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.336511] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.337401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.337401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.337401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.337401] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.337401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.337401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.337688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.337688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.337761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.337901] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.338000] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.338088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.338238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.338408] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.338468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.338534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.338715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.338794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.340358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.340358] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.475413] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.475683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.475867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.476030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.476226] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.476358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.476422] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.476647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.476746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.477187] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.477187] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.477308] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.477342] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.477817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.477817] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.477987] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.477987] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.478192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.479045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.479045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.479045] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.842428] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 179594e5-59bd-41ce-8082-1aa739538096: rpc.has_security_group_logging(os_id): False [ 866.875485] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.875698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.875698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.875912] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.876015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.876218] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.876347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.876413] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.876537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.876782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.877012] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.877124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.877186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.877335] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.877420] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.877615] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.877707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.877764] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.877906] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.877982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.878079] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be created. [ 866.971467] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.971628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.971743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.972488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.972488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.981196] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 614443cd-8cb8-47ec-8a41-58ab513d082d: rpc.has_security_group_logging(os_id): False [ 866.992724] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: IN_PROGRESS for 2s [ 867.006728] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.006728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.006728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.007064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.007064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.007358] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.007358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.007358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.007510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.007597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.008442] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.008442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.008442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.008442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.008442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.008634] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.008634] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.008758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.008959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.009078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.009187] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 867.104039] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.104039] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.104039] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.104320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.104370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.128335] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 867.267783] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 867.267783] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 869.009261] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: SUCCESS [ 869.009561] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.147538] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 869.147922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.832575] env[65136]: INFO networking_nsxv3.common.synchronization [req-e735e9af-e0b5-4088-8f95-2a995e2e6255 req-48dddb0a-da5f-46f5-808f-8acbaa19c680 tempest-ServerAddressesTestJSON-1604587442 tempest-ServerAddressesTestJSON-1604587442-project-member] Enqueued Resource ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 with Priority: HIGHEST for action security_group_members [ 870.833452] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 with Priority: HIGHEST for action security_group_members [ 870.833585] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.833681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.833723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.833924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.835541] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.835541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.835541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.835541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.835541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.835541] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a503f8a3-35c3-4780-8cb3-fb17a0c4a452',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.339493] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.339756] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.339824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.340064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.340162] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.340388] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.340488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.340551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.340704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.340787] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.340875] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 is going to be updated. [ 871.375913] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.376124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.376291] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.376491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.376677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.388027] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 in Status: IN_PROGRESS for 2s [ 871.794100] env[65136]: INFO networking_nsxv3.common.synchronization [None req-bc311e4d-d628-43dc-beeb-665ea807c147 None None] Enqueued Resource ID: 94e832b8-36cc-432a-ad95-8e053756c2d0 with Priority: HIGHEST for action port [ 871.794100] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94e832b8-36cc-432a-ad95-8e053756c2d0 with Priority: HIGHEST for action port [ 871.794100] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-94e832b8-36cc-432a-ad95-8e053756c2d0 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.794100] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94e832b8-36cc-432a-ad95-8e053756c2d0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.794100] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94e832b8-36cc-432a-ad95-8e053756c2d0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.794100] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94e832b8-36cc-432a-ad95-8e053756c2d0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.794100] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94e832b8-36cc-432a-ad95-8e053756c2d0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.296733] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94e832b8-36cc-432a-ad95-8e053756c2d0 [ 872.298331] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.298331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.298331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.298331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.298331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.298331] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94e832b8-36cc-432a-ad95-8e053756c2d0 already deleted. [ 872.298598] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94e832b8-36cc-432a-ad95-8e053756c2d0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.404466] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 in Status: SUCCESS [ 873.404466] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a503f8a3-35c3-4780-8cb3-fb17a0c4a452 deletion is rescheduled due to dependency. [ 873.404466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a503f8a3-35c3-4780-8cb3-fb17a0c4a452" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.490363] env[65136]: INFO networking_nsxv3.common.synchronization [None req-3314bdb6-1785-4c08-8d5f-488d5f375632 None None] Enqueued Resource ID: fbde73b6-9e4f-4ee0-92e5-af6d2b7af351 with Priority: HIGHEST for action port [ 874.491590] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbde73b6-9e4f-4ee0-92e5-af6d2b7af351 with Priority: HIGHEST for action port [ 874.491590] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbde73b6-9e4f-4ee0-92e5-af6d2b7af351 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.491590] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbde73b6-9e4f-4ee0-92e5-af6d2b7af351" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.491590] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbde73b6-9e4f-4ee0-92e5-af6d2b7af351" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.491815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbde73b6-9e4f-4ee0-92e5-af6d2b7af351" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.491815] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbde73b6-9e4f-4ee0-92e5-af6d2b7af351',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.996217] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbde73b6-9e4f-4ee0-92e5-af6d2b7af351 [ 874.996478] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.996616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.996723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.996900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.996988] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.997130] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbde73b6-9e4f-4ee0-92e5-af6d2b7af351 already deleted. [ 874.997219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbde73b6-9e4f-4ee0-92e5-af6d2b7af351" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.015555] env[65136]: INFO networking_nsxv3.common.synchronization [req-78499724-d530-4ee4-9e25-6c67d69de540 req-5b5f64e3-f477-425b-82aa-d8a502dd1a66 tempest-MultipleCreateTestJSON-1748696551 tempest-MultipleCreateTestJSON-1748696551-project-member] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 876.016310] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 876.016654] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.017508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.017508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.017508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.017508] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.017508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.017794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.017794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.017794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.017927] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.473917] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-117 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.474121] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.474252] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.474521] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.475226] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.475531] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.475663] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.476011] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.476228] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.476518] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.476696] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.476893] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.477086] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.477243] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.477359] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.477550] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.502891] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.503534] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 876.503534] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.503690] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-117" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.504607] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-8e9340f5-cafb-445e-a7e3-5ca027b14119 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.504607] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-8e9340f5-cafb-445e-a7e3-5ca027b14119" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.504607] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-8e9340f5-cafb-445e-a7e3-5ca027b14119" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.504789] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-8e9340f5-cafb-445e-a7e3-5ca027b14119" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.504843] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e9340f5-cafb-445e-a7e3-5ca027b14119',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.520631] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.009102] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.009385] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.009508] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.009776] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.009938] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.010105] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 8e9340f5-cafb-445e-a7e3-5ca027b14119 not found, creating... [ 877.010797] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.010986] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.011152] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.011453] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.011619] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.012788] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.013173] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.013640] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.013982] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.014206] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.014467] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 8e9340f5-cafb-445e-a7e3-5ca027b14119 is going to be created. [ 877.022883] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.043947] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.044731] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.044946] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.045371] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.045734] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.046107] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-8e9340f5-cafb-445e-a7e3-5ca027b14119" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.525887] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.526300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.526300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.526416] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.526500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.526595] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be updated. [ 877.565136] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.565307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.565393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.565613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.565771] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.577041] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: IN_PROGRESS for 2s [ 877.728603] env[65136]: INFO networking_nsxv3.common.synchronization [req-78499724-d530-4ee4-9e25-6c67d69de540 req-b4826a0c-ccb4-4693-8401-1001488dec91 service nova] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_rules [ 877.728793] env[65136]: INFO networking_nsxv3.common.synchronization [req-78499724-d530-4ee4-9e25-6c67d69de540 req-b4826a0c-ccb4-4693-8401-1001488dec91 service nova] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 877.728977] env[65136]: INFO networking_nsxv3.common.synchronization [req-78499724-d530-4ee4-9e25-6c67d69de540 req-b4826a0c-ccb4-4693-8401-1001488dec91 service nova] Enqueued Resource ID: 8e9340f5-cafb-445e-a7e3-5ca027b14119 with Priority: HIGHEST for action port [ 877.729544] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_rules [ 877.729691] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 877.729768] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e9340f5-cafb-445e-a7e3-5ca027b14119 with Priority: HIGHEST for action port [ 877.730274] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.730431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.730501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.730710] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.730796] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.733686] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.733686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.733686] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e9340f5-cafb-445e-a7e3-5ca027b14119 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.733686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e9340f5-cafb-445e-a7e3-5ca027b14119" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.733686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e9340f5-cafb-445e-a7e3-5ca027b14119" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.733686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e9340f5-cafb-445e-a7e3-5ca027b14119" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.733686] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e9340f5-cafb-445e-a7e3-5ca027b14119',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.097608] env[65136]: INFO networking_nsxv3.common.synchronization [req-65d2ee2b-c60b-432b-9113-8c2d9da5476b req-2d1f593c-3ea3-451c-ae38-8a306c6618f4 tempest-MigrationsAdminTest-368591407 tempest-MigrationsAdminTest-368591407-project-member] Enqueued Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_members [ 878.098334] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_members [ 878.098993] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a04e899-b185-4f20-8eea-e0edb95feabb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.099152] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.099222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.100348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.100542] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.100720] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.100986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.101197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.101318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.101432] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.234707] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.234914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.235052] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e9340f5-cafb-445e-a7e3-5ca027b14119 with status ACTIVE [ 878.235239] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.235367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.235435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.235601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.235688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.235855] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.235943] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.236011] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.236158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.236233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.236412] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.236526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.236603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.236735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.236870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.236870] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e9340f5-cafb-445e-a7e3-5ca027b14119 is going to be updated. [ 878.266998] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.266998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.266998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.266998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.266998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.270115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e9340f5-cafb-445e-a7e3-5ca027b14119" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.607469] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.969580] env[65136]: INFO networking_nsxv3.common.synchronization [None req-c5e7f890-fa52-4fc4-a3c4-001a5a76fc48 None None] Enqueued Resource ID: 7227fdcd-b62a-40ff-a03e-d38365c86dd4 with Priority: HIGHEST for action port [ 878.970180] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7227fdcd-b62a-40ff-a03e-d38365c86dd4 with Priority: HIGHEST for action port [ 878.970499] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-7227fdcd-b62a-40ff-a03e-d38365c86dd4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.970646] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7227fdcd-b62a-40ff-a03e-d38365c86dd4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.970728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7227fdcd-b62a-40ff-a03e-d38365c86dd4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.970984] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7227fdcd-b62a-40ff-a03e-d38365c86dd4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.971083] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7227fdcd-b62a-40ff-a03e-d38365c86dd4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.110257] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.474177] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7227fdcd-b62a-40ff-a03e-d38365c86dd4 [ 879.474177] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.474177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.474177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.474177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.474177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.474177] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7227fdcd-b62a-40ff-a03e-d38365c86dd4 already deleted. [ 879.474177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7227fdcd-b62a-40ff-a03e-d38365c86dd4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.598177] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: SUCCESS [ 879.598177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.598177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.598177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.598177] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.598177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.598177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.598177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.598177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.598177] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.612349] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.612554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.612940] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.612940] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.613014] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.613110] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a04e899-b185-4f20-8eea-e0edb95feabb is going to be updated. [ 879.646508] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.646508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.646508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.646747] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.646900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.657723] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a04e899-b185-4f20-8eea-e0edb95feabb in Status: IN_PROGRESS for 2s [ 880.101296] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.603724] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.110235] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.110813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.110813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.110813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.110813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.110813] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be updated. [ 881.122026] env[65136]: INFO networking_nsxv3.common.synchronization [req-cadc5dde-391f-492a-9bdc-ad49e613ce40 req-fa655fd2-b390-4588-bc97-7ff364170901 tempest-ServerRescueTestJSON-1597968343 tempest-ServerRescueTestJSON-1597968343-project-member] Enqueued Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_members [ 881.122744] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGHEST for action security_group_members [ 881.122928] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-246d2702-c0f1-4486-92fb-beb4b3b1950e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.123064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.123145] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.123339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.123512] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.123583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.123615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.123760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.123873] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.123923] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.148723] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.148723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.148723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.149439] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.151032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.159768] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: IN_PROGRESS for 2s [ 881.400809] env[65136]: INFO networking_nsxv3.common.synchronization [None req-def16513-9df4-4219-9007-b75905d32f75 None None] Enqueued Resource ID: 53a42b06-1a92-4f0f-af2c-4195ef5fc34a with Priority: HIGHEST for action port [ 881.401822] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53a42b06-1a92-4f0f-af2c-4195ef5fc34a with Priority: HIGHEST for action port [ 881.405582] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-53a42b06-1a92-4f0f-af2c-4195ef5fc34a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.405863] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53a42b06-1a92-4f0f-af2c-4195ef5fc34a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.405863] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53a42b06-1a92-4f0f-af2c-4195ef5fc34a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.406087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53a42b06-1a92-4f0f-af2c-4195ef5fc34a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.406178] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53a42b06-1a92-4f0f-af2c-4195ef5fc34a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.626176] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.626176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.626176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.626478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.663837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.664195] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.664324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.665284] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.665284] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.665284] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.665284] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e is going to be updated. [ 881.672575] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a04e899-b185-4f20-8eea-e0edb95feabb in Status: SUCCESS [ 881.672872] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.737638] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.737638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.737638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.737638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.737923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.747662] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e in Status: IN_PROGRESS for 2s [ 881.911414] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53a42b06-1a92-4f0f-af2c-4195ef5fc34a [ 881.911659] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.911796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.911868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.912106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.912199] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.912296] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53a42b06-1a92-4f0f-af2c-4195ef5fc34a already deleted. [ 881.912477] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53a42b06-1a92-4f0f-af2c-4195ef5fc34a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.148399] env[65136]: INFO networking_nsxv3.common.synchronization [req-31cdb0e3-7607-4d32-9069-f392aef28e08 req-fe73068a-ba41-4dac-b699-c54979ad0a23 tempest-ServersAdminTestJSON-92432023 tempest-ServersAdminTestJSON-92432023-project-member] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 883.149632] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 883.149632] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.149632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.149632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.149632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.149874] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.149874] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.149980] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.150085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.150319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.150319] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.168708] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: SUCCESS [ 883.169011] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.170164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.170373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.170562] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.170702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.170848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.171159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.171280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.171375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.171468] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.652982] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.675481] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.675656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.675749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.677304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.677304] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.677304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.677304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.677304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.677304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.677304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.677304] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.677304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.677304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.677304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.677706] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.677706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.677706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.677706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.677809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.677809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.677903] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.758928] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e in Status: SUCCESS [ 883.759157] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e deletion is rescheduled due to dependency. [ 883.759281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.155146] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.181716] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 179594e5-59bd-41ce-8082-1aa739538096: rpc.has_security_group_logging(os_id): False [ 884.199830] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.200021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.200100] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.200311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.200401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.200631] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.200728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.200789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.200949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.201040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.201246] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.201338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.201398] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.201535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.201882] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.201882] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.201882] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.202019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.202111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.202237] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.202382] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be updated. [ 884.263304] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.263476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.263534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.263736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.263884] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.281910] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: IN_PROGRESS for 2s [ 884.658642] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.658889] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.659009] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.659259] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.659373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.659533] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be updated. [ 884.691085] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.691402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.691490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.693096] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.693286] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.702636] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: IN_PROGRESS for 2s [ 885.696970] env[65136]: INFO networking_nsxv3.common.synchronization [req-22f179c8-2c3c-44d5-9620-65c718b92dfc req-dc305c57-1c7e-4345-9fd4-b5c7b131fc96 tempest-ServerDiskConfigTestJSON-1818502390 tempest-ServerDiskConfigTestJSON-1818502390-project-member] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 885.697959] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 885.698318] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.698616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.698616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.698756] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.698931] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.699093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.699182] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.699340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.699428] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.699528] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.021107] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.021298] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.021423] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.022025] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.022025] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.022262] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.022373] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.022923] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.023102] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.023338] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.023528] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.023687] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.023899] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.023956] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.024031] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.024169] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.044992] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.045263] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 886.045426] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.045640] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.046135] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-9eff741e-39fb-4933-8b35-4b275496f6a5 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.046216] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-9eff741e-39fb-4933-8b35-4b275496f6a5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.046308] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-9eff741e-39fb-4933-8b35-4b275496f6a5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.046643] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-9eff741e-39fb-4933-8b35-4b275496f6a5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.046787] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9eff741e-39fb-4933-8b35-4b275496f6a5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.204338] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.204338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.204338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.204338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.204338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.204338] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.204338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.204338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.204338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.204338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.204338] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be deleted. [ 886.238333] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.238559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.238559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.238763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.238893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.239018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.302554] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: SUCCESS [ 886.302554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.549175] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.549444] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.549588] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.549927] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.550114] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.550277] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 9eff741e-39fb-4933-8b35-4b275496f6a5 not found, creating... [ 886.550540] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.550738] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.550804] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.551044] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.551184] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.551461] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.551617] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.551733] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.552020] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.552208] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.552451] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 9eff741e-39fb-4933-8b35-4b275496f6a5 is going to be created. [ 886.582354] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.582590] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.582699] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.582973] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.583322] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.583452] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-9eff741e-39fb-4933-8b35-4b275496f6a5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.720052] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 886.720370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.301777] env[65136]: INFO networking_nsxv3.common.synchronization [req-22f179c8-2c3c-44d5-9620-65c718b92dfc req-5f77fce0-9e7f-42ec-8ef7-d5b0d5a78262 service nova] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_rules [ 887.302145] env[65136]: INFO networking_nsxv3.common.synchronization [req-22f179c8-2c3c-44d5-9620-65c718b92dfc req-5f77fce0-9e7f-42ec-8ef7-d5b0d5a78262 service nova] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 887.302145] env[65136]: INFO networking_nsxv3.common.synchronization [req-22f179c8-2c3c-44d5-9620-65c718b92dfc req-5f77fce0-9e7f-42ec-8ef7-d5b0d5a78262 service nova] Enqueued Resource ID: 9eff741e-39fb-4933-8b35-4b275496f6a5 with Priority: HIGHEST for action port [ 887.302749] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_rules [ 887.302935] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 887.303140] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eff741e-39fb-4933-8b35-4b275496f6a5 with Priority: HIGHEST for action port [ 887.303732] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.303732] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.303877] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.304942] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.304942] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.305858] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.306218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.306218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.306325] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.306475] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.306591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.306673] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.306890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.306978] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.307467] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.308077] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-9eff741e-39fb-4933-8b35-4b275496f6a5 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.308211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9eff741e-39fb-4933-8b35-4b275496f6a5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.308521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9eff741e-39fb-4933-8b35-4b275496f6a5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.308521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9eff741e-39fb-4933-8b35-4b275496f6a5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.308521] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9eff741e-39fb-4933-8b35-4b275496f6a5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.811485] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.811851] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.811851] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.813047] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9eff741e-39fb-4933-8b35-4b275496f6a5 with status ACTIVE [ 887.813281] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.813433] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.813523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.813812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.813960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.814189] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.814432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.814534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.814757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.814928] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.815350] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.815456] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.815549] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.815732] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.815834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.815951] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9eff741e-39fb-4933-8b35-4b275496f6a5 is going to be updated. [ 887.846394] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.846394] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.846394] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.846693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.846736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.846981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9eff741e-39fb-4933-8b35-4b275496f6a5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.318639] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.629810] env[65136]: INFO networking_nsxv3.common.synchronization [req-7ccadc39-1a31-4e8a-a134-5baa49801cbf req-ec595272-f249-482d-b051-45a3123c939f tempest-MultipleCreateTestJSON-1748696551 tempest-MultipleCreateTestJSON-1748696551-project-member] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 888.630404] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 888.630721] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.630839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.630903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.631158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.631375] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.631447] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.631619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.632537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.632537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.632537] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.818272] env[65136]: INFO networking_nsxv3.common.synchronization [req-7a17e218-9039-4bdd-a490-e6b263fdec23 req-490da3d8-4a42-4dca-a3f8-e8fef4e655fe tempest-MultipleCreateTestJSON-1748696551 tempest-MultipleCreateTestJSON-1748696551-project-member] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 888.819600] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGHEST for action security_group_members [ 888.820094] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.820321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.823151] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.823425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.823597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.823885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.825208] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.825208] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be created. [ 888.851815] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.851815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.851815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.852054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.852225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.867771] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: UNINITIALIZED for 2s [ 889.134865] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.638049] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.140457] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.141297] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.141381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.141616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.141715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.141822] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be updated. [ 890.185110] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.185323] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.185323] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.185548] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.185690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.199502] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: IN_PROGRESS for 2s [ 890.216871] env[65136]: INFO networking_nsxv3.common.synchronization [req-25346e64-c139-42b5-950a-406ae2cec60a req-7a935e29-b667-490a-b740-77e95f296f30 tempest-ListServerFiltersTestJSON-1251039073 tempest-ListServerFiltersTestJSON-1251039073-project-member] Enqueued Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 890.218060] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 890.218060] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.218060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.218060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.218290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.218369] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.218647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.218647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.218647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.218744] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.218799] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.720532] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.877016] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 890.877247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.877408] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.877629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.877820] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.877934] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.878033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.878197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.878279] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.878365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.878458] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.223290] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.383234] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.383234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.383234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.383234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.383234] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.383234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.383234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.383234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.383234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.383234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.383234] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.383234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.383234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.383234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.383234] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.383234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.383814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.383814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.383814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.383814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.383814] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.726376] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.726510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.726566] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.726783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.726866] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.726962] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b is going to be updated. [ 891.762409] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.762601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.762715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.762963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.763143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.777809] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: IN_PROGRESS for 2s [ 891.886429] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605661ba-c8c2-4dae-8382-f55a5d1ead5d: rpc.has_security_group_logging(os_id): False [ 891.904586] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.904789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.904911] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.905234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.905484] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.905603] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.905735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.905839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.906120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.906280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.906578] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.906758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.906886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.907139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.907273] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.907587] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.907713] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.907797] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.907911] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.907986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.908123] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be created. [ 891.966025] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.966025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.966025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.966025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.966257] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.985934] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 892.210902] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: SUCCESS [ 892.210902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.211201] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.211448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.211668] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.211744] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.211823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.211957] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.212049] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.212143] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.714528] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.716072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.716072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.716072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.716072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.716072] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.716072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.716072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.716414] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.716414] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.716414] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be updated. [ 892.749451] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.749704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.749704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.749899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.750109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.761710] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: IN_PROGRESS for 2s [ 893.790205] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: SUCCESS [ 893.790490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.000961] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 894.001508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.772075] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 179594e5-59bd-41ce-8082-1aa739538096 in Status: SUCCESS [ 894.772289] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 179594e5-59bd-41ce-8082-1aa739538096 deletion is rescheduled due to dependency. [ 894.772289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.218240] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 895.218521] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 896.004125] env[65136]: INFO networking_nsxv3.common.synchronization [req-2bd9dbdc-9db8-439b-8797-0c455267662f req-7f1445c8-4d45-4e39-8736-4a075b953206 tempest-ImagesTestJSON-1051903205 tempest-ImagesTestJSON-1051903205-project-member] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 896.004125] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 896.004125] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.004125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.004125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.004125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.004125] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.004125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.004125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.004125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.004125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.004125] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.507528] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.507858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.507858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.508047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.508150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.508349] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.508446] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.508505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.508651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.508728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.508813] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 896.536708] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.536953] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.537129] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.537359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.537514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.547736] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 897.032062] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-63 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.032062] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.032062] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.032293] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.032540] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.032694] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.032839] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.033108] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.033338] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.033640] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.033822] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.033992] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.034172] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.034295] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.034404] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.034535] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.054870] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.055071] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 897.055215] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.055399] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.055730] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-8931c212-fa1d-4f8b-9038-c842f45326e4 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.055927] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-8931c212-fa1d-4f8b-9038-c842f45326e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.056088] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-8931c212-fa1d-4f8b-9038-c842f45326e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.056479] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-8931c212-fa1d-4f8b-9038-c842f45326e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.056619] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8931c212-fa1d-4f8b-9038-c842f45326e4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.559468] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.559774] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.559813] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.560133] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.560301] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.561703] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 8931c212-fa1d-4f8b-9038-c842f45326e4 not found, creating... [ 897.562343] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.562343] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.562343] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.562894] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.562894] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.563016] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.563739] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.564242] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.564242] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.564242] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.564354] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 8931c212-fa1d-4f8b-9038-c842f45326e4 is going to be created. [ 897.586651] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.586935] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.587091] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.587703] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.587703] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.587858] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-8931c212-fa1d-4f8b-9038-c842f45326e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.370811] env[65136]: INFO networking_nsxv3.common.synchronization [req-2bd9dbdc-9db8-439b-8797-0c455267662f req-07013a02-04c3-4e35-885a-022ef62b92a0 service nova] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_rules [ 898.371072] env[65136]: INFO networking_nsxv3.common.synchronization [req-2bd9dbdc-9db8-439b-8797-0c455267662f req-07013a02-04c3-4e35-885a-022ef62b92a0 service nova] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 898.371239] env[65136]: INFO networking_nsxv3.common.synchronization [req-2bd9dbdc-9db8-439b-8797-0c455267662f req-07013a02-04c3-4e35-885a-022ef62b92a0 service nova] Enqueued Resource ID: 8931c212-fa1d-4f8b-9038-c842f45326e4 with Priority: HIGHEST for action port [ 898.371969] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_rules [ 898.372336] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 898.372512] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8931c212-fa1d-4f8b-9038-c842f45326e4 with Priority: HIGHEST for action port [ 898.372894] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.373143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.373177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.373421] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.373685] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.375236] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.375446] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.375780] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-8931c212-fa1d-4f8b-9038-c842f45326e4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.375986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8931c212-fa1d-4f8b-9038-c842f45326e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.376067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8931c212-fa1d-4f8b-9038-c842f45326e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.376293] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8931c212-fa1d-4f8b-9038-c842f45326e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.376443] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8931c212-fa1d-4f8b-9038-c842f45326e4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.558969] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 898.558969] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 deletion is rescheduled due to dependency. [ 898.558969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.558969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.558969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.558969] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.559244] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.559244] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.559297] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.559473] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.559473] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.606209] env[65136]: INFO networking_nsxv3.common.synchronization [req-b4c4df92-edae-4347-900b-1d8afe53e64a req-b2f37771-4d48-41ce-aedf-0917177a68b0 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 898.606699] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 898.607023] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.607191] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.607266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.607427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.607585] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.607669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.607961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.607961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.607961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.608262] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.880600] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.880757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.880912] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8931c212-fa1d-4f8b-9038-c842f45326e4 with status ACTIVE [ 898.881098] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.881201] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.881268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.881474] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.882096] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.882096] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.882096] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.882260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.882302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.882379] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.882561] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.882654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.882714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.882855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.882928] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.883029] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8931c212-fa1d-4f8b-9038-c842f45326e4 is going to be updated. [ 898.910025] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.910025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.910025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.910255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.910396] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.910558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8931c212-fa1d-4f8b-9038-c842f45326e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.948123] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-289 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.948339] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-289" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.948479] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-289" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.948739] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-289" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.949214] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.949380] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.949500] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.950118] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.950118] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.950118] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.950245] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.950319] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.950850] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.950850] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.950850] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.950850] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 898.973752] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 898.973752] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 898.973752] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 898.973958] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-289" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.974836] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-6acbecc2-ee1e-49c1-82e6-196de92e98cc taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.974836] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.974836] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.975055] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.975178] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6acbecc2-ee1e-49c1-82e6-196de92e98cc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.061737] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.110380] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.478346] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.478719] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.478967] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.479317] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.479475] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.479667] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 6acbecc2-ee1e-49c1-82e6-196de92e98cc not found, creating... [ 899.479948] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.480159] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.480283] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.480502] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.480671] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.480989] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.481196] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.481325] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.481537] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.481670] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.481809] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 6acbecc2-ee1e-49c1-82e6-196de92e98cc is going to be created. [ 899.502142] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.502388] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.502524] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.503355] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.503618] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.503868] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.563957] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.613983] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.066163] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.066335] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.066405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.066726] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.066821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.066920] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 900.107573] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.107715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.107792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.107983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.108141] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.115250] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.115490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.115593] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.115855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.115990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.116115] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 900.118133] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 900.152229] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.152353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.152432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.152654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.152800] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.162580] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 900.191988] env[65136]: INFO networking_nsxv3.common.synchronization [req-b4c4df92-edae-4347-900b-1d8afe53e64a req-3786e3f7-0120-44d9-95d9-c87b24ed07d9 service nova] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_rules [ 900.192620] env[65136]: INFO networking_nsxv3.common.synchronization [req-b4c4df92-edae-4347-900b-1d8afe53e64a req-3786e3f7-0120-44d9-95d9-c87b24ed07d9 service nova] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 900.192786] env[65136]: INFO networking_nsxv3.common.synchronization [req-b4c4df92-edae-4347-900b-1d8afe53e64a req-3786e3f7-0120-44d9-95d9-c87b24ed07d9 service nova] Enqueued Resource ID: 6acbecc2-ee1e-49c1-82e6-196de92e98cc with Priority: HIGHEST for action port [ 900.195430] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_rules [ 900.195573] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 900.195689] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6acbecc2-ee1e-49c1-82e6-196de92e98cc with Priority: HIGHEST for action port [ 900.195978] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.196126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.196188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.196395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.196468] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.197390] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.197487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.198096] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-6acbecc2-ee1e-49c1-82e6-196de92e98cc taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.198096] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.198096] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.198096] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.198453] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6acbecc2-ee1e-49c1-82e6-196de92e98cc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.700154] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.700154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.702956] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6acbecc2-ee1e-49c1-82e6-196de92e98cc with status ACTIVE [ 900.702956] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.702956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.702956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.702956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.702956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.702956] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.702956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.702956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.702956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.702956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.702956] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.703352] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.703352] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.703408] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.703553] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.703553] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6acbecc2-ee1e-49c1-82e6-196de92e98cc is going to be updated. [ 900.724898] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.724898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.724898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.725165] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.725212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.725335] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.041729] env[65136]: INFO networking_nsxv3.common.synchronization [req-0676853c-71b4-4244-94b9-e4342adf3c94 req-eef18593-fdbe-4c89-9d8a-9c997e41da8a tempest-ServersTestJSON-425456513 tempest-ServersTestJSON-425456513-project-member] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 901.042313] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 901.044315] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.044454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.044528] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.044748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.044900] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.044996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.045071] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.045213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.045295] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.045387] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.382760] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.382970] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.383111] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.383454] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.383724] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.383891] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.384097] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.384339] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.384505] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.384718] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.384839] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.384957] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.385082] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.385204] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.385311] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.385452] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.408499] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.408666] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 901.408833] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.409106] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.409434] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.409614] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.409736] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.410145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.410299] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.547663] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.547663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.547663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.547967] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.547967] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.548180] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.548253] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.548289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.548438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.548535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.548613] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 already deleted. [ 901.548669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.914081] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.914081] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.914081] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.914463] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.914500] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.914636] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87 not found, creating... [ 901.914903] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.915079] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.915283] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.915543] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.915697] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.915985] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.916160] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.916278] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.916512] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.916654] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.916797] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87 is going to be created. [ 901.938593] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.938885] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.939153] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.939502] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.939776] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.940065] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.132009] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 902.132257] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.132802] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.132962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.133224] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.133384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.133465] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.133678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.133763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.133868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.133990] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.173248] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 902.173521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.173733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.174012] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.174234] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.174374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.174452] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.174643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.174734] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.174851] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.637071] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.637281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.637321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.637552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.637728] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.637833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.637901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.638113] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.638210] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.638304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.638459] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.638556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.638620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.638766] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.638906] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.639040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.639076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.639224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.639303] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.639390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.639566] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.678997] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.681695] env[65136]: INFO networking_nsxv3.common.synchronization [req-0676853c-71b4-4244-94b9-e4342adf3c94 req-af9fac2b-e8cc-4c28-8be0-9e2329fa001c service nova] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_rules [ 902.681695] env[65136]: INFO networking_nsxv3.common.synchronization [req-0676853c-71b4-4244-94b9-e4342adf3c94 req-af9fac2b-e8cc-4c28-8be0-9e2329fa001c service nova] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 902.681695] env[65136]: INFO networking_nsxv3.common.synchronization [req-0676853c-71b4-4244-94b9-e4342adf3c94 req-af9fac2b-e8cc-4c28-8be0-9e2329fa001c service nova] Enqueued Resource ID: 8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87 with Priority: HIGHEST for action port [ 902.682164] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_rules [ 902.682240] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 902.682331] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87 with Priority: HIGHEST for action port [ 902.682908] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.682908] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.682908] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.683285] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.683285] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.684699] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.684892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.686338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.686338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.686338] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.686338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.686338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.686338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.686662] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.686662] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.687651] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.687780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.689864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.689864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.689864] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.145144] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15: rpc.has_security_group_logging(os_id): False [ 903.164027] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.164172] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.164249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.164452] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.164545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.164753] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.164849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.166156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.166156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.166156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.166156] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.166156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.166156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.166156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.166156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.166156] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.166156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.166156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.167309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.167309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.167309] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 903.180884] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.191054] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87 with status ACTIVE [ 903.191519] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.191716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.191752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.192340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.192340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.192445] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.192588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.192680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.194108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.194108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.194108] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.194108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.194108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.194108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.194108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.194108] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87 is going to be updated. [ 903.195921] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.195921] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.195921] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.219539] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.219701] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.219820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.220086] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.220279] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.220469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b3b0717-a1b0-48b3-95e2-57b4c8a9ae87" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.238267] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.238522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.238522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.238796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.239119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.255588] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 903.664375] env[65136]: INFO networking_nsxv3.common.synchronization [req-418553ec-dc9f-4ca7-bdb0-6846f6a6d0ff req-184690b0-0e0e-41ee-b23b-41872db8e6e2 tempest-ServerActionsTestJSON-513195432 tempest-ServerActionsTestJSON-513195432-project-member] Enqueued Resource ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e with Priority: HIGHEST for action security_group_members [ 903.665095] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e with Priority: HIGHEST for action security_group_members [ 903.665501] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c51c2cd-9219-40af-b979-dfebe3666f2e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.665662] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.665741] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.666377] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.666377] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.666377] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.666377] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.666558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.666558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.667256] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c51c2cd-9219-40af-b979-dfebe3666f2e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.685602] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.685602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.685602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.685602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.685602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.685602] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 903.700418] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.718031] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.718031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.718031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.718031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.718251] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.730731] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 904.022269] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-360 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.022486] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.022612] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.022881] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.023158] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.023347] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.023532] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.023714] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.023860] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.025343] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.025608] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.025785] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.025993] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.026119] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.026358] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.026402] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.046388] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.046551] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 904.046686] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.046884] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.047239] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-34c429df-ccee-4630-b9fb-d4fbddf08cc0 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.047505] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-34c429df-ccee-4630-b9fb-d4fbddf08cc0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.047565] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-34c429df-ccee-4630-b9fb-d4fbddf08cc0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.047852] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-34c429df-ccee-4630-b9fb-d4fbddf08cc0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.047979] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34c429df-ccee-4630-b9fb-d4fbddf08cc0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.169307] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.169746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.169746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.169746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.169901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.170321] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.170321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.170321] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.170524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.170573] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.170617] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e already deleted. [ 904.170702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.202921] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.203092] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.203163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.203379] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.203468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.203550] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be created. [ 904.241525] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.241681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.241811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.242088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.242515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.253842] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: UNINITIALIZED for 2s [ 904.316071] env[65136]: INFO networking_nsxv3.common.synchronization [req-e7c2fa63-0e1f-483a-a031-dba1460a65b3 req-2744f5ab-d945-4f9d-b02e-415e4a247cae tempest-DeleteServersTestJSON-1045367082 tempest-DeleteServersTestJSON-1045367082-project-member] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 904.316568] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 904.316982] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.317176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.317225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.317464] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.317651] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.317786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.317871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.318080] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.318202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.318323] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.550919] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.550919] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.550919] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.551334] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.551532] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.551727] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 34c429df-ccee-4630-b9fb-d4fbddf08cc0 not found, creating... [ 904.552147] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.552338] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.552475] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.552827] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.553031] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.553445] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.553632] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.553777] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.554106] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.554272] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.554451] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 34c429df-ccee-4630-b9fb-d4fbddf08cc0 is going to be created. [ 904.580195] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.580483] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.580614] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.580892] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.581217] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.581472] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-34c429df-ccee-4630-b9fb-d4fbddf08cc0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.821063] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.280629] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 905.281126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.310517] env[65136]: INFO networking_nsxv3.common.synchronization [req-418553ec-dc9f-4ca7-bdb0-6846f6a6d0ff req-7d859e20-7330-4c4f-baf2-7ae0a9fad527 service nova] Enqueued Resource ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e with Priority: HIGHEST for action security_group_rules [ 905.310719] env[65136]: INFO networking_nsxv3.common.synchronization [req-418553ec-dc9f-4ca7-bdb0-6846f6a6d0ff req-7d859e20-7330-4c4f-baf2-7ae0a9fad527 service nova] Enqueued Resource ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e with Priority: HIGHEST for action security_group_members [ 905.310863] env[65136]: INFO networking_nsxv3.common.synchronization [req-418553ec-dc9f-4ca7-bdb0-6846f6a6d0ff req-7d859e20-7330-4c4f-baf2-7ae0a9fad527 service nova] Enqueued Resource ID: 34c429df-ccee-4630-b9fb-d4fbddf08cc0 with Priority: HIGHEST for action port [ 905.311498] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e with Priority: HIGHEST for action security_group_rules [ 905.311640] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e with Priority: HIGHEST for action security_group_members [ 905.311729] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34c429df-ccee-4630-b9fb-d4fbddf08cc0 with Priority: HIGHEST for action port [ 905.312591] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c51c2cd-9219-40af-b979-dfebe3666f2e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.313746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.313746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.313746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.313746] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c51c2cd-9219-40af-b979-dfebe3666f2e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.314220] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c51c2cd-9219-40af-b979-dfebe3666f2e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.314409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.314486] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.314683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.314846] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.314942] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.315018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.315170] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.315254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.315345] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c51c2cd-9219-40af-b979-dfebe3666f2e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.316270] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-34c429df-ccee-4630-b9fb-d4fbddf08cc0 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.317197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34c429df-ccee-4630-b9fb-d4fbddf08cc0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.317291] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34c429df-ccee-4630-b9fb-d4fbddf08cc0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.317466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34c429df-ccee-4630-b9fb-d4fbddf08cc0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.317548] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34c429df-ccee-4630-b9fb-d4fbddf08cc0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.323314] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.741824] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 905.742138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.742194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.742408] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.742798] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.742898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.742898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.743085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.743139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.743332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.743332] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.819482] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2c51c2cd-9219-40af-b979-dfebe3666f2e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.820810] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c51c2cd-9219-40af-b979-dfebe3666f2e taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.820810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.820810] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 34c429df-ccee-4630-b9fb-d4fbddf08cc0 with status ACTIVE [ 905.821028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.821463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.821463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.821463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.821619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.821724] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.821891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.821927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.822132] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.822454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.822550] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.822600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.822628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.822825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.822926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.823020] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 34c429df-ccee-4630-b9fb-d4fbddf08cc0 is going to be updated. [ 905.824529] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.824626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.824763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.824875] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.824972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.825087] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 905.858543] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.858759] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.858759] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.859048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.859141] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.859292] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34c429df-ccee-4630-b9fb-d4fbddf08cc0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.869768] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.869946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.869995] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.870308] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.870497] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.882032] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 906.246166] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.248042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.248042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.248286] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.248552] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.248744] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.248865] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.249232] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.249494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.249601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.249995] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.250106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.250425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.250475] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.250674] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.250864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.250935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.251540] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.251540] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.251540] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.251540] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.265966] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 906.266257] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.266455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.266709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.266964] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.267143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.267212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.267377] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.267512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.267602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.267702] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.321477] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2c51c2cd-9219-40af-b979-dfebe3666f2e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.754975] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 614443cd-8cb8-47ec-8a41-58ab513d082d: rpc.has_security_group_logging(os_id): False [ 906.772463] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.772634] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.772707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.772939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.773132] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.773233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.773298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.773447] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.773535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.773622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.773766] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.773858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.773919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.774077] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.774212] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.774302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.774365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.774499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.774574] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.774654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.774743] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.776443] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.776555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.776623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.776774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.776856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.777077] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.777218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.777247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.777417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.777495] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.777674] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.777962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.777962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.777962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.778092] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.778210] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.778347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.778437] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.778587] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.778662] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.778745] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 906.824553] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.824743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.824815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.825022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.825112] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.826048] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e is going to be created. [ 906.852839] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.853098] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.853098] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.853404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.853404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.861842] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.862059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.862059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.862263] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.862429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.871979] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e in Status: UNINITIALIZED for 2s [ 906.872689] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 907.282812] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a99f7e35-ad71-4640-a081-3c507e997901: rpc.has_security_group_logging(os_id): False [ 907.318068] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.318387] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.318534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.319301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.319494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.320083] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.320308] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.320435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.320767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.320955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.321599] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.321958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.321958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.322244] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.322368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.323288] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.323490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.323625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.323924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.324098] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.324289] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be created. [ 907.423087] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.423237] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.423302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.423610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.423911] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.442092] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 907.892850] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 907.894353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.285026] env[65136]: INFO networking_nsxv3.common.synchronization [req-0fd62347-f312-4abd-9377-a30879abfbef req-fd731467-f28d-4a44-b6e6-f302bfedb891 tempest-ServerGroupTestJSON-615433633 tempest-ServerGroupTestJSON-615433633-project-member] Enqueued Resource ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c with Priority: HIGHEST for action security_group_members [ 908.285026] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c with Priority: HIGHEST for action security_group_members [ 908.286713] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f4864-4465-4dbe-9836-f8fba02f451c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.287305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.290245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.290245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.290245] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.290245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.290245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.290245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.290245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.290245] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d7f4864-4465-4dbe-9836-f8fba02f451c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.676297] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-681 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.676685] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-681" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.676685] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-681" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.676956] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-681" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.677338] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.677497] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.677612] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.677821] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.677969] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.678449] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.678579] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.678696] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.678806] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.678974] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.679139] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.679276] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.699372] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.699528] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 908.699666] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.699833] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-681" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.700162] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-5a62cf88-f639-4fa4-a934-f1adaa4a422f taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.700324] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-5a62cf88-f639-4fa4-a934-f1adaa4a422f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.700440] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-5a62cf88-f639-4fa4-a934-f1adaa4a422f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.700779] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-5a62cf88-f639-4fa4-a934-f1adaa4a422f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.700949] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a62cf88-f639-4fa4-a934-f1adaa4a422f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.792385] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.792589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.792655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.792883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.792963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.793177] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.793307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.793389] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.793544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.793617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.793700] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c already deleted. [ 908.793777] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.886695] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e in Status: SUCCESS [ 908.887023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.887241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.887454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.887647] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.887767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.887834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.887991] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.888085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.888205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.888314] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2c51c2cd-9219-40af-b979-dfebe3666f2e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.894963] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 908.895075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.205274] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.205595] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.205704] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.206140] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.206299] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.206466] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 5a62cf88-f639-4fa4-a934-f1adaa4a422f not found, creating... [ 909.206737] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.206974] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.207123] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.207451] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.207642] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.207972] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.208202] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.208342] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.208639] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.208857] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.209132] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 5a62cf88-f639-4fa4-a934-f1adaa4a422f is going to be created. [ 909.257189] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.257332] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.257517] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.257741] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.258139] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.258325] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-5a62cf88-f639-4fa4-a934-f1adaa4a422f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.376706] env[65136]: INFO networking_nsxv3.common.synchronization [req-953f836a-729f-45c3-9918-57ba99d4387f req-9b5879e7-3980-4a9a-a8de-f095fba0c780 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGHEST for action security_group_members [ 909.377021] env[65136]: INFO networking_nsxv3.common.synchronization [req-953f836a-729f-45c3-9918-57ba99d4387f req-9b5879e7-3980-4a9a-a8de-f095fba0c780 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 909.377947] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGHEST for action security_group_members [ 909.378125] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 909.378575] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5de81c0-7123-460c-83a6-919b0bf8e09a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.378778] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.378860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.379304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.379553] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.379757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.379856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.380048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.380246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.380414] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.381725] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.382562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.382562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.382562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.383480] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.383480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.383480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.383653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.383688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.384345] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.391369] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2c51c2cd-9219-40af-b979-dfebe3666f2e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.443679] env[65136]: INFO networking_nsxv3.common.synchronization [req-953f836a-729f-45c3-9918-57ba99d4387f req-9b5879e7-3980-4a9a-a8de-f095fba0c780 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_rules [ 909.443857] env[65136]: INFO networking_nsxv3.common.synchronization [req-953f836a-729f-45c3-9918-57ba99d4387f req-9b5879e7-3980-4a9a-a8de-f095fba0c780 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 909.443995] env[65136]: INFO networking_nsxv3.common.synchronization [req-953f836a-729f-45c3-9918-57ba99d4387f req-9b5879e7-3980-4a9a-a8de-f095fba0c780 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGHEST for action security_group_rules [ 909.444402] env[65136]: INFO networking_nsxv3.common.synchronization [req-953f836a-729f-45c3-9918-57ba99d4387f req-9b5879e7-3980-4a9a-a8de-f095fba0c780 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGHEST for action security_group_members [ 909.444608] env[65136]: INFO networking_nsxv3.common.synchronization [req-953f836a-729f-45c3-9918-57ba99d4387f req-9b5879e7-3980-4a9a-a8de-f095fba0c780 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 6acbecc2-ee1e-49c1-82e6-196de92e98cc with Priority: HIGHEST for action port [ 909.446388] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_rules [ 909.446578] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGHEST for action security_group_rules [ 909.446750] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6acbecc2-ee1e-49c1-82e6-196de92e98cc with Priority: HIGHEST for action port [ 909.446882] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 909.446978] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGHEST for action security_group_members [ 909.447359] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.447519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.447602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.447846] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.447932] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.449350] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5de81c0-7123-460c-83a6-919b0bf8e09a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.449491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.449532] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.449789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.449835] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.452281] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-6acbecc2-ee1e-49c1-82e6-196de92e98cc taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.452393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.452494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.452622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.452709] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6acbecc2-ee1e-49c1-82e6-196de92e98cc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.453505] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.453604] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.453838] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5de81c0-7123-460c-83a6-919b0bf8e09a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.453885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.473521] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 909.473724] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.887383] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.888247] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.898712] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2c51c2cd-9219-40af-b979-dfebe3666f2e: rpc.has_security_group_logging(os_id): False [ 909.920078] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.920285] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.920382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.921790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.921790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.921790] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.921790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.921790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.921790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.921790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.922139] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e is going to be created. [ 909.952591] env[65136]: INFO networking_nsxv3.common.synchronization [req-0fd62347-f312-4abd-9377-a30879abfbef req-c8793bbc-41a0-4e6f-8bb0-26cdb5c9f83b service nova] Enqueued Resource ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c with Priority: HIGHEST for action security_group_rules [ 909.952795] env[65136]: INFO networking_nsxv3.common.synchronization [req-0fd62347-f312-4abd-9377-a30879abfbef req-c8793bbc-41a0-4e6f-8bb0-26cdb5c9f83b service nova] Enqueued Resource ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c with Priority: HIGHEST for action security_group_members [ 909.952977] env[65136]: INFO networking_nsxv3.common.synchronization [req-0fd62347-f312-4abd-9377-a30879abfbef req-c8793bbc-41a0-4e6f-8bb0-26cdb5c9f83b service nova] Enqueued Resource ID: 5a62cf88-f639-4fa4-a934-f1adaa4a422f with Priority: HIGHEST for action port [ 909.953755] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5de81c0-7123-460c-83a6-919b0bf8e09a taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.953896] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.954352] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c with Priority: HIGHEST for action security_group_rules [ 909.954465] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c with Priority: HIGHEST for action security_group_members [ 909.954604] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a62cf88-f639-4fa4-a934-f1adaa4a422f with Priority: HIGHEST for action port [ 909.954932] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d7f4864-4465-4dbe-9836-f8fba02f451c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.955094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.955160] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.955449] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.956492] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d7f4864-4465-4dbe-9836-f8fba02f451c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.957142] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f4864-4465-4dbe-9836-f8fba02f451c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.957142] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.957142] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.957254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.957403] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.957519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.957582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.957810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.959517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.959517] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d7f4864-4465-4dbe-9836-f8fba02f451c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.961743] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a62cf88-f639-4fa4-a934-f1adaa4a422f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.961743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a62cf88-f639-4fa4-a934-f1adaa4a422f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.961743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a62cf88-f639-4fa4-a934-f1adaa4a422f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.961743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a62cf88-f639-4fa4-a934-f1adaa4a422f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.961743] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a62cf88-f639-4fa4-a934-f1adaa4a422f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.963080] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.963230] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.963446] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6acbecc2-ee1e-49c1-82e6-196de92e98cc with status ACTIVE [ 909.963958] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.963958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.963958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.963958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.964871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.964871] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.964871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.964871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.964871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.964871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.964871] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.965217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.965217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.965217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.965294] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.965559] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6acbecc2-ee1e-49c1-82e6-196de92e98cc is going to be updated. [ 909.988058] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.988058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.988058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.988058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.988058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.988058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.999861] env[65136]: INFO networking_nsxv3.common.synchronization [req-5c25de38-6f54-4b28-b99f-12e1a0e3731d req-4ede60dc-cfe4-479c-89b0-0e2aa929e960 tempest-ServerMetadataNegativeTestJSON-872035205 tempest-ServerMetadataNegativeTestJSON-872035205-project-member] Enqueued Resource ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 with Priority: HIGHEST for action security_group_members [ 910.000754] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 with Priority: HIGHEST for action security_group_members [ 910.001937] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f599cf2b-60b7-4420-ad22-ed55d836f3a9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.002475] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.002684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.003541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.004087] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.004690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.004900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.007053] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.007053] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.007053] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f599cf2b-60b7-4420-ad22-ed55d836f3a9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.025304] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.025600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.025717] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.026041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.028247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.045193] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e in Status: IN_PROGRESS for 2s [ 910.392572] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.393989] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.427813] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-317 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.428099] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-317" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.428236] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-317" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.428617] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-317" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.429155] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.429298] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.429563] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.429755] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.429933] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.430169] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.430322] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.430447] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.430554] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.430667] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.430771] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.431089] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.463439] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d7f4864-4465-4dbe-9836-f8fba02f451c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.464882] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f4864-4465-4dbe-9836-f8fba02f451c taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.465785] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.466907] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a62cf88-f639-4fa4-a934-f1adaa4a422f with status ACTIVE [ 910.467413] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.467695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.467695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.467795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.467840] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.468018] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.468121] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.468177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.468331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.468410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.468623] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.468729] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.468814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.468941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.469083] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.469723] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a62cf88-f639-4fa4-a934-f1adaa4a422f is going to be updated. [ 910.470761] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.470875] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 910.471718] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.471718] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-317" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.471718] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-b5b439cd-f57b-427a-95ac-b8f2d0c82954 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.471718] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-b5b439cd-f57b-427a-95ac-b8f2d0c82954" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.471718] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-b5b439cd-f57b-427a-95ac-b8f2d0c82954" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.471970] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-b5b439cd-f57b-427a-95ac-b8f2d0c82954" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.472119] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5b439cd-f57b-427a-95ac-b8f2d0c82954',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.510764] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.510870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.510972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.511264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.511509] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.511630] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.511731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.511854] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.511945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.512091] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.512514] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 already deleted. [ 910.512514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.514053] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.514179] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.514240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.514494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.514710] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.514963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a62cf88-f639-4fa4-a934-f1adaa4a422f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.896818] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.896818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.896818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.897339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.897339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.897339] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5de81c0-7123-460c-83a6-919b0bf8e09a is going to be created. [ 910.898470] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.898592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.898660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.898840] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.898927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.899084] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 910.936021] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.936193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.936250] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.936507] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.936653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.938891] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.939120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.939232] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.939430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.939579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.950712] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 910.956862] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5de81c0-7123-460c-83a6-919b0bf8e09a in Status: UNINITIALIZED for 2s [ 910.966415] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d7f4864-4465-4dbe-9836-f8fba02f451c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.975043] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.975043] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.975043] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.975369] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.975531] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.975610] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port b5b439cd-f57b-427a-95ac-b8f2d0c82954 not found, creating... [ 910.976131] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.976131] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.976427] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.976427] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.976570] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.976838] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.977022] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.977152] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.977381] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.977528] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.977705] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: b5b439cd-f57b-427a-95ac-b8f2d0c82954 is going to be created. [ 911.010950] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.011262] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.011355] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.011663] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.011921] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.012204] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-b5b439cd-f57b-427a-95ac-b8f2d0c82954" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.469144] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.469342] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.469421] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.469622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.469710] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.469806] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c is going to be created. [ 911.501936] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.502127] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.502194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.502633] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.502633] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.514421] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c in Status: UNINITIALIZED for 2s [ 911.758677] env[65136]: INFO networking_nsxv3.common.synchronization [req-5c25de38-6f54-4b28-b99f-12e1a0e3731d req-c1d752af-4077-4887-a84d-412d7c1cf7e6 service nova] Enqueued Resource ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 with Priority: HIGHEST for action security_group_rules [ 911.759000] env[65136]: INFO networking_nsxv3.common.synchronization [req-5c25de38-6f54-4b28-b99f-12e1a0e3731d req-c1d752af-4077-4887-a84d-412d7c1cf7e6 service nova] Enqueued Resource ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 with Priority: HIGHEST for action security_group_members [ 911.759300] env[65136]: INFO networking_nsxv3.common.synchronization [req-5c25de38-6f54-4b28-b99f-12e1a0e3731d req-c1d752af-4077-4887-a84d-412d7c1cf7e6 service nova] Enqueued Resource ID: b5b439cd-f57b-427a-95ac-b8f2d0c82954 with Priority: HIGHEST for action port [ 911.760235] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 with Priority: HIGHEST for action security_group_rules [ 911.760516] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 with Priority: HIGHEST for action security_group_members [ 911.760516] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5b439cd-f57b-427a-95ac-b8f2d0c82954 with Priority: HIGHEST for action port [ 911.761032] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f599cf2b-60b7-4420-ad22-ed55d836f3a9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.761126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.761249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.761614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.761755] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f599cf2b-60b7-4420-ad22-ed55d836f3a9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.763134] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f599cf2b-60b7-4420-ad22-ed55d836f3a9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.763337] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.763470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.763727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.763973] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.764135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.764256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.764512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.764667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.765083] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f599cf2b-60b7-4420-ad22-ed55d836f3a9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.768821] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5b439cd-f57b-427a-95ac-b8f2d0c82954 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.768821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5b439cd-f57b-427a-95ac-b8f2d0c82954" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.768821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5b439cd-f57b-427a-95ac-b8f2d0c82954" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.768821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5b439cd-f57b-427a-95ac-b8f2d0c82954" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.768821] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5b439cd-f57b-427a-95ac-b8f2d0c82954',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.841231] env[65136]: INFO networking_nsxv3.common.synchronization [req-562ecc9f-a112-41a2-aa18-dbe9f40ee9e0 req-77689abd-236c-4c89-8c02-c98aef476b22 tempest-MigrationsAdminTest-368591407 tempest-MigrationsAdminTest-368591407-project-member] Enqueued Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_members [ 911.841847] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a04e899-b185-4f20-8eea-e0edb95feabb with Priority: HIGHEST for action security_group_members [ 911.842176] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a04e899-b185-4f20-8eea-e0edb95feabb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.842552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.842552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.842552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.842716] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.842802] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.842862] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.843009] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.843831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.844174] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a04e899-b185-4f20-8eea-e0edb95feabb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.060067] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e in Status: SUCCESS [ 912.060806] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.269466] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f599cf2b-60b7-4420-ad22-ed55d836f3a9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.270834] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f599cf2b-60b7-4420-ad22-ed55d836f3a9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.270963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.271118] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5b439cd-f57b-427a-95ac-b8f2d0c82954 with status ACTIVE [ 912.271344] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.271458] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.271527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.272119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.272119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.272119] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.272240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.272356] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.272566] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.272681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.272975] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.273121] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.273217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.273399] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.273575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.273697] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5b439cd-f57b-427a-95ac-b8f2d0c82954 is going to be updated. [ 912.342918] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.343177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.343177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.343372] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.343532] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.343734] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5b439cd-f57b-427a-95ac-b8f2d0c82954" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.348142] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.348476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.348476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.348606] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.384275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.384546] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.384670] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.384733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.384932] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.385026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.385118] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a04e899-b185-4f20-8eea-e0edb95feabb is going to be updated. [ 912.430218] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.430379] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.430419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.430626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.430765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.454192] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a04e899-b185-4f20-8eea-e0edb95feabb in Status: IN_PROGRESS for 2s [ 912.775734] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f599cf2b-60b7-4420-ad22-ed55d836f3a9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.972332] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 912.972332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.972332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.972655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.972655] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.972775] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.972848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.973123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.973283] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.973478] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.977070] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5de81c0-7123-460c-83a6-919b0bf8e09a in Status: SUCCESS [ 912.977185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.977330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.977589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.977866] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.977978] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.978053] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.978266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.981036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.981036] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.278411] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.279076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.279076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.279076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.279076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.279076] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 is going to be created. [ 913.315375] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.315603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.315682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.315898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.316229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.329646] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 in Status: UNINITIALIZED for 2s [ 913.481383] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.482666] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.525915] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c in Status: SUCCESS [ 913.525915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.525915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.526127] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.526363] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.526434] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.526468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.526613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.526693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.526964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.526964] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d7f4864-4465-4dbe-9836-f8fba02f451c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.985637] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.986433] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.030795] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f4864-4465-4dbe-9836-f8fba02f451c taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.031758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.032430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.033645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.033866] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.033994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.034076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.034260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.034351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.034440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.034715] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f4864-4465-4dbe-9836-f8fba02f451c taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.034825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.034905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.035099] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.035240] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.035330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.035388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.035523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.035603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.035703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.035876] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d7f4864-4465-4dbe-9836-f8fba02f451c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.465762] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a04e899-b185-4f20-8eea-e0edb95feabb in Status: SUCCESS [ 914.466128] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a04e899-b185-4f20-8eea-e0edb95feabb deletion is rescheduled due to dependency. [ 914.466245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a04e899-b185-4f20-8eea-e0edb95feabb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.488058] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.488295] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.488360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.488584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.488646] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.488751] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 914.490986] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.490986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.490986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.490986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.490986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.490986] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5de81c0-7123-460c-83a6-919b0bf8e09a is going to be updated. [ 914.521190] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.521455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.521584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.521837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.521999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.523910] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.524059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.524139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.524346] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.524510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.535840] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5de81c0-7123-460c-83a6-919b0bf8e09a in Status: IN_PROGRESS for 2s [ 914.536641] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 914.537939] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d7f4864-4465-4dbe-9836-f8fba02f451c: rpc.has_security_group_logging(os_id): False [ 914.556455] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.556715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.556715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.556919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.557010] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.557229] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.557331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.557398] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.557549] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.557615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.557788] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.557879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.557940] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.558091] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.558165] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.558352] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.558442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.558504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.558652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.558727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.559834] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c is going to be created. [ 914.608050] env[65136]: INFO networking_nsxv3.common.synchronization [req-512b7b75-af85-4a2c-8c42-2630890d7a0b req-2ac22786-6525-47cb-a1f8-340c2097a012 tempest-ServersAdminTestJSON-92432023 tempest-ServersAdminTestJSON-92432023-project-member] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 914.609095] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 914.609709] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.609907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.610094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.610387] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.610761] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.610987] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.611168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.611462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.611566] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.611726] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.636513] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.636960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.636960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.636960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.637193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.658436] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c in Status: IN_PROGRESS for 2s [ 915.114408] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.347814] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 in Status: SUCCESS [ 915.347814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.348088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.349046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.349554] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.349749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.349825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.350183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.350539] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.350539] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.350640] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f599cf2b-60b7-4420-ad22-ed55d836f3a9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.616850] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.694681] env[65136]: INFO networking_nsxv3.common.synchronization [None req-658e33c6-1ade-48e3-8d56-ec1e438dd707 None None] Enqueued Resource ID: 34a9e7f9-172f-41d1-b233-512e90255e91 with Priority: HIGHEST for action port [ 915.695171] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a9e7f9-172f-41d1-b233-512e90255e91 with Priority: HIGHEST for action port [ 915.695500] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-34a9e7f9-172f-41d1-b233-512e90255e91 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.695621] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34a9e7f9-172f-41d1-b233-512e90255e91" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.695686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34a9e7f9-172f-41d1-b233-512e90255e91" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.695937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34a9e7f9-172f-41d1-b233-512e90255e91" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.696519] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34a9e7f9-172f-41d1-b233-512e90255e91',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.856028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f599cf2b-60b7-4420-ad22-ed55d836f3a9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.856028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.856028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.856028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.856028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.856028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.856028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.856028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.856028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.856028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.856028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f599cf2b-60b7-4420-ad22-ed55d836f3a9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.856028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.856028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.856028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.856028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.856028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.856960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.857527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.857794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.858033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.859235] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f599cf2b-60b7-4420-ad22-ed55d836f3a9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.120093] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.120340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.120419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.120660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.120764] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.122047] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be updated. [ 916.157265] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.157413] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.157513] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.157679] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.157816] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.168198] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: IN_PROGRESS for 2s [ 916.198693] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34a9e7f9-172f-41d1-b233-512e90255e91 [ 916.198925] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.199110] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.199224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.199457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.199552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.199661] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34a9e7f9-172f-41d1-b233-512e90255e91 already deleted. [ 916.199750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34a9e7f9-172f-41d1-b233-512e90255e91" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.361560] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f599cf2b-60b7-4420-ad22-ed55d836f3a9: rpc.has_security_group_logging(os_id): False [ 916.381421] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.381624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.381664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.381876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.381962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.382192] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.382367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.382367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.382493] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.382569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.382751] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.382845] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.382907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.383058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.383149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.383402] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.383504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.383565] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.383705] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.383779] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.383863] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 is going to be created. [ 916.446488] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.446663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.446728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.447641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.447641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.463206] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 in Status: IN_PROGRESS for 2s [ 916.553688] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5de81c0-7123-460c-83a6-919b0bf8e09a in Status: SUCCESS [ 916.553688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.553688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.553688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.553688] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.553688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.553688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.553688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.553688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.553688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.553688] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.560231] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 916.562243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.562243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.562243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.562243] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.562243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.562243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.562243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.562243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.562243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.562243] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.693020] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c in Status: SUCCESS [ 916.693020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.059729] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.064857] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.064857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.064857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.064857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.064857] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.064857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.064857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.064857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.064857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.064857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.064857] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.065867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.065867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.065867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.065867] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.065867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.065867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.065867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.065867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.065867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.065867] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.563283] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5de81c0-7123-460c-83a6-919b0bf8e09a: rpc.has_security_group_logging(os_id): False [ 917.569894] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 614443cd-8cb8-47ec-8a41-58ab513d082d: rpc.has_security_group_logging(os_id): False [ 917.587357] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.587357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.587357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.587357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.587357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.588947] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.589090] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.589166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.589371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.589492] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.589628] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5de81c0-7123-460c-83a6-919b0bf8e09a is going to be created. [ 917.591729] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.591841] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.591914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.592790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.592790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.592790] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.592790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.592790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.592790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.593698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.594330] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.594330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.594330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.594330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.594601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.594651] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.595214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.595214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.596834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.596834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.596834] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 917.694299] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.694299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.694299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.694871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.694871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.714890] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.715067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.716117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.716117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.716117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.726968] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 917.727847] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5de81c0-7123-460c-83a6-919b0bf8e09a in Status: IN_PROGRESS for 2s [ 918.179738] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 918.180028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.478177] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 in Status: SUCCESS [ 918.478334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.902270] env[65136]: INFO networking_nsxv3.common.synchronization [None req-17c76b72-50ce-4fbf-9bd6-1795bb5d206c None None] Enqueued Resource ID: 406f78b6-1ca9-4bdb-9be2-fd251784d6fe with Priority: HIGHEST for action port [ 918.902270] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 406f78b6-1ca9-4bdb-9be2-fd251784d6fe with Priority: HIGHEST for action port [ 918.902270] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-406f78b6-1ca9-4bdb-9be2-fd251784d6fe taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.902270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-406f78b6-1ca9-4bdb-9be2-fd251784d6fe" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.902270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-406f78b6-1ca9-4bdb-9be2-fd251784d6fe" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.902828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-406f78b6-1ca9-4bdb-9be2-fd251784d6fe" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.902828] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('406f78b6-1ca9-4bdb-9be2-fd251784d6fe',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.038434] env[65136]: INFO networking_nsxv3.common.synchronization [req-7b284b3e-9764-4c9f-b9fb-f720cf674074 req-1de111af-5fcc-4a68-863c-b4c3ecf4f876 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c with Priority: HIGHEST for action security_group_members [ 919.038499] env[65136]: INFO networking_nsxv3.common.synchronization [req-7b284b3e-9764-4c9f-b9fb-f720cf674074 req-1de111af-5fcc-4a68-863c-b4c3ecf4f876 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGHEST for action security_group_members [ 919.038585] env[65136]: INFO networking_nsxv3.common.synchronization [req-7b284b3e-9764-4c9f-b9fb-f720cf674074 req-1de111af-5fcc-4a68-863c-b4c3ecf4f876 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 919.039248] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c with Priority: HIGHEST for action security_group_members [ 919.039390] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGHEST for action security_group_members [ 919.039488] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 919.039769] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e81f8e0e-8756-4918-b89d-656b7e5ea30c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.039890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.039954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.040343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.041024] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.041024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.041024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.041024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.041024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.041386] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e81f8e0e-8756-4918-b89d-656b7e5ea30c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.044021] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5de81c0-7123-460c-83a6-919b0bf8e09a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.044021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.044021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.044021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.044021] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.044021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.044021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.044021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.044021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.044021] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.044021] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.044021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.044021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.044733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.044733] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.044733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.044835] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.045707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.045707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.045707] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.104424] env[65136]: INFO networking_nsxv3.common.synchronization [req-7b284b3e-9764-4c9f-b9fb-f720cf674074 req-1de111af-5fcc-4a68-863c-b4c3ecf4f876 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_rules [ 919.104672] env[65136]: INFO networking_nsxv3.common.synchronization [req-7b284b3e-9764-4c9f-b9fb-f720cf674074 req-1de111af-5fcc-4a68-863c-b4c3ecf4f876 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 919.104752] env[65136]: INFO networking_nsxv3.common.synchronization [req-7b284b3e-9764-4c9f-b9fb-f720cf674074 req-1de111af-5fcc-4a68-863c-b4c3ecf4f876 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGHEST for action security_group_rules [ 919.104879] env[65136]: INFO networking_nsxv3.common.synchronization [req-7b284b3e-9764-4c9f-b9fb-f720cf674074 req-1de111af-5fcc-4a68-863c-b4c3ecf4f876 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGHEST for action security_group_members [ 919.105017] env[65136]: INFO networking_nsxv3.common.synchronization [req-7b284b3e-9764-4c9f-b9fb-f720cf674074 req-1de111af-5fcc-4a68-863c-b4c3ecf4f876 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c with Priority: HIGHEST for action security_group_rules [ 919.105152] env[65136]: INFO networking_nsxv3.common.synchronization [req-7b284b3e-9764-4c9f-b9fb-f720cf674074 req-1de111af-5fcc-4a68-863c-b4c3ecf4f876 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c with Priority: HIGHEST for action security_group_members [ 919.105283] env[65136]: INFO networking_nsxv3.common.synchronization [req-7b284b3e-9764-4c9f-b9fb-f720cf674074 req-1de111af-5fcc-4a68-863c-b4c3ecf4f876 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 6acbecc2-ee1e-49c1-82e6-196de92e98cc with Priority: HIGHEST for action port [ 919.105901] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_rules [ 919.110303] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGHEST for action security_group_rules [ 919.110303] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c with Priority: HIGHEST for action security_group_members [ 919.110303] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6acbecc2-ee1e-49c1-82e6-196de92e98cc with Priority: HIGHEST for action port [ 919.110303] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c with Priority: HIGHEST for action security_group_rules [ 919.110303] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 919.110303] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGHEST for action security_group_members [ 919.110709] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.110709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.111335] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5de81c0-7123-460c-83a6-919b0bf8e09a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.111469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.111849] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e81f8e0e-8756-4918-b89d-656b7e5ea30c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.111952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.112886] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-6acbecc2-ee1e-49c1-82e6-196de92e98cc taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.112886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.112886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.112886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.112886] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6acbecc2-ee1e-49c1-82e6-196de92e98cc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.114423] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e81f8e0e-8756-4918-b89d-656b7e5ea30c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.114668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.114776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.115062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.115794] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e81f8e0e-8756-4918-b89d-656b7e5ea30c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.118358] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.118485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.118702] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5de81c0-7123-460c-83a6-919b0bf8e09a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.118815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.398272] env[65136]: INFO networking_nsxv3.common.synchronization [req-e3535b2f-6d45-4582-8252-4b5c597a5e1d req-2006b525-33ad-468d-b38b-083f9e8a8eb8 tempest-ListServerFiltersTestJSON-1251039073 tempest-ListServerFiltersTestJSON-1251039073-project-member] Enqueued Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 919.398916] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGHEST for action security_group_members [ 919.399179] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.399326] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.399401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.399603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.399756] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.399840] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.399905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.401311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.401354] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.401446] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.405435] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 406f78b6-1ca9-4bdb-9be2-fd251784d6fe [ 919.405435] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.405576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.405576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.405743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.405827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.405918] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:406f78b6-1ca9-4bdb-9be2-fd251784d6fe already deleted. [ 919.406017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-406f78b6-1ca9-4bdb-9be2-fd251784d6fe" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.546785] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e81f8e0e-8756-4918-b89d-656b7e5ea30c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.547837] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.552357] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.620990] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6acbecc2-ee1e-49c1-82e6-196de92e98cc with status ACTIVE [ 919.621620] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.621620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.621620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.621620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.621854] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.621883] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.622487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.622487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.622487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.622487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.622487] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.622709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.622709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.623246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.623246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.623384] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6acbecc2-ee1e-49c1-82e6-196de92e98cc is going to be updated. [ 919.628962] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e81f8e0e-8756-4918-b89d-656b7e5ea30c taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.629153] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.653515] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.653762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.653762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.653981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.654241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.654552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6acbecc2-ee1e-49c1-82e6-196de92e98cc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.750166] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5de81c0-7123-460c-83a6-919b0bf8e09a in Status: SUCCESS [ 919.750482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.750682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.750913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.751014] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.756314] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 919.756585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.757176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.757455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.759182] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.906537] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.906932] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.906932] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.907080] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.928357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.928761] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.928901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.929131] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.929216] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.929267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.929354] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b is going to be updated. [ 919.961596] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.961596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.961596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.961596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.961596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.971384] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: IN_PROGRESS for 2s [ 920.053295] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e81f8e0e-8756-4918-b89d-656b7e5ea30c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.054522] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.055521] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.258473] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5de81c0-7123-460c-83a6-919b0bf8e09a taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.258882] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.262346] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.262346] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.558590] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.558785] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.558871] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.559265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.559371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.559486] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c is going to be created. [ 920.560931] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.563350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.563500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.563737] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.563848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.563907] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 920.565269] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.565582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.565582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.565827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.565827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.565827] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5de81c0-7123-460c-83a6-919b0bf8e09a is going to be updated. [ 920.603041] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.603041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.603041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.603041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.603041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.605184] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.605376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.605430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.605748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.605978] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.608635] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.608635] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.608635] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.609508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.609508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.613750] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c in Status: UNINITIALIZED for 2s [ 920.619160] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5de81c0-7123-460c-83a6-919b0bf8e09a in Status: IN_PROGRESS for 2s [ 920.619964] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 920.694412] env[65136]: INFO networking_nsxv3.common.synchronization [None req-f0e722b9-1ae8-4137-9a94-d4e044059ad8 None None] Enqueued Resource ID: 1f277d95-8026-4501-bfd1-3583d913c891 with Priority: HIGHEST for action port [ 920.694986] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f277d95-8026-4501-bfd1-3583d913c891 with Priority: HIGHEST for action port [ 920.695378] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f277d95-8026-4501-bfd1-3583d913c891 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.695500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f277d95-8026-4501-bfd1-3583d913c891" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.695570] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f277d95-8026-4501-bfd1-3583d913c891" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.695895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f277d95-8026-4501-bfd1-3583d913c891" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.695984] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f277d95-8026-4501-bfd1-3583d913c891',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.197908] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f277d95-8026-4501-bfd1-3583d913c891 [ 921.198211] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.198326] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.198696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.198931] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.199078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.199190] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f277d95-8026-4501-bfd1-3583d913c891 already deleted. [ 921.199277] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f277d95-8026-4501-bfd1-3583d913c891" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.983771] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b in Status: SUCCESS [ 921.983972] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b deletion is rescheduled due to dependency. [ 921.984109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.637483] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c in Status: SUCCESS [ 922.637872] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.638058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.638233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.638530] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.638761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.638834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.639103] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.639233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.639510] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e81f8e0e-8756-4918-b89d-656b7e5ea30c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.642470] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 922.642651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.643551] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5de81c0-7123-460c-83a6-919b0bf8e09a in Status: SUCCESS [ 922.644163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.644163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.644787] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.645185] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.645185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.645317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.645416] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.645503] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.645601] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.648357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.648357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.648357] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.648357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.648357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.648357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.648357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.648357] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.876380] env[65136]: INFO networking_nsxv3.common.synchronization [req-69bd7688-9518-4d8e-8ba2-faac81e19ee6 req-7cde8eff-5a2f-4a91-8a15-f89a2f885855 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGHEST for action security_group_members [ 922.876551] env[65136]: INFO networking_nsxv3.common.synchronization [req-69bd7688-9518-4d8e-8ba2-faac81e19ee6 req-7cde8eff-5a2f-4a91-8a15-f89a2f885855 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 922.876838] env[65136]: INFO networking_nsxv3.common.synchronization [req-69bd7688-9518-4d8e-8ba2-faac81e19ee6 req-7cde8eff-5a2f-4a91-8a15-f89a2f885855 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c with Priority: HIGHEST for action security_group_members [ 922.879369] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGHEST for action security_group_members [ 922.879369] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 922.879369] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c with Priority: HIGHEST for action security_group_members [ 922.879369] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b5de81c0-7123-460c-83a6-919b0bf8e09a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.879369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.879369] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.879369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.879369] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e81f8e0e-8756-4918-b89d-656b7e5ea30c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.879369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.149543] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e81f8e0e-8756-4918-b89d-656b7e5ea30c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.151835] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.154111] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.222216] env[65136]: INFO networking_nsxv3.common.synchronization [req-b2f535b1-0f26-4461-b310-1a9d90d9573d req-45d8b0c3-b2be-494c-8e9e-0952fa5e9a8a tempest-ServerGroupTestJSON-615433633 tempest-ServerGroupTestJSON-615433633-project-member] Enqueued Resource ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c with Priority: HIGHEST for action security_group_members [ 923.222989] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c with Priority: HIGHEST for action security_group_members [ 923.223774] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d7f4864-4465-4dbe-9836-f8fba02f451c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.223774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.223774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.223774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.223974] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.223974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.224069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.224206] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.224273] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.224366] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d7f4864-4465-4dbe-9836-f8fba02f451c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.657229] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.658353] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e81f8e0e-8756-4918-b89d-656b7e5ea30c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.659184] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.686264] env[65136]: INFO networking_nsxv3.common.synchronization [req-acf8ec82-b010-467e-b3ec-29b714a3c6df req-1d3c2ad7-f9d7-4d43-9288-71bb69c4d35a tempest-ServersWithSpecificFlavorTestJSON-92176410 tempest-ServersWithSpecificFlavorTestJSON-92176410-project-member] Enqueued Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_members [ 923.686264] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGHEST for action security_group_members [ 923.686264] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.686264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.686264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.686264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.686264] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.686264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.686264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.686264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.686264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.686937] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.726341] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.726341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.726467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.726670] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.726775] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.726970] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.727130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.727196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.727294] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.727388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.727451] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c is going to be updated. [ 923.764817] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.764817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.765087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.765122] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.765651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.780134] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c in Status: IN_PROGRESS for 2s [ 924.161564] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.161692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.161749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.161957] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.162053] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.162157] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5de81c0-7123-460c-83a6-919b0bf8e09a is going to be updated. [ 924.163359] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.163493] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.163548] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.163712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.163818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.163886] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c is going to be updated. [ 924.164948] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.165059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.165135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.165287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.165370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.165607] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 924.190242] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.190440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.190505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.190727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.210465] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.210628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.210671] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.210877] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.211030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.227829] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.227829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.227829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.227829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.227829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.232028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.232233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.232233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.233108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.233530] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.245200] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.245609] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.246106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.246106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.246106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.246106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.246259] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 is going to be updated. [ 924.247826] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c in Status: IN_PROGRESS for 2s [ 924.249095] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5de81c0-7123-460c-83a6-919b0bf8e09a in Status: IN_PROGRESS for 2s [ 924.250280] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 924.304785] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.305330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.305330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.305710] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.305846] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.321931] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: IN_PROGRESS for 2s [ 925.793473] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c in Status: SUCCESS [ 925.793473] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d7f4864-4465-4dbe-9836-f8fba02f451c deletion is rescheduled due to dependency. [ 925.793473] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d7f4864-4465-4dbe-9836-f8fba02f451c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.208312] env[65136]: INFO networking_nsxv3.common.synchronization [None req-ea001d6e-ffbc-4373-9b78-adec066d14d6 None None] Enqueued Resource ID: 3569eacd-fc1f-450d-9eea-fdd03cec01de with Priority: HIGHEST for action port [ 926.212019] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3569eacd-fc1f-450d-9eea-fdd03cec01de with Priority: HIGHEST for action port [ 926.212019] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-3569eacd-fc1f-450d-9eea-fdd03cec01de taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.212019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3569eacd-fc1f-450d-9eea-fdd03cec01de" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.212019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3569eacd-fc1f-450d-9eea-fdd03cec01de" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.212458] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3569eacd-fc1f-450d-9eea-fdd03cec01de" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.212458] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3569eacd-fc1f-450d-9eea-fdd03cec01de',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.259432] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c in Status: SUCCESS [ 926.259432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.259432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.259432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.259432] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.259432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.259432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.259432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.259432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.259927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.259927] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e81f8e0e-8756-4918-b89d-656b7e5ea30c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.262965] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5de81c0-7123-460c-83a6-919b0bf8e09a in Status: SUCCESS [ 926.263207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.266037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.266037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.266037] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.266037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.266037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.266037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.266037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.266037] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e81f8e0e-8756-4918-b89d-656b7e5ea30c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.266037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.266037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.266037] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.266037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.266828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.266828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.266828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.266924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.267125] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.271832] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 926.271832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.271832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.271998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.272148] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.272210] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.272243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.272672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.272762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.272944] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.276174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.276174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.276174] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.276174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.276387] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.276804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.276937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.277140] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.277250] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.278918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.279230] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.279298] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.279419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.279465] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.279689] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.279689] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.279779] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.332642] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 in Status: SUCCESS [ 926.332833] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 deletion is rescheduled due to dependency. [ 926.332938] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.714363] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3569eacd-fc1f-450d-9eea-fdd03cec01de [ 926.715614] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.715614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.715614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.715614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.715614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.715614] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3569eacd-fc1f-450d-9eea-fdd03cec01de already deleted. [ 926.715614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3569eacd-fc1f-450d-9eea-fdd03cec01de" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.756084] env[65136]: INFO networking_nsxv3.common.synchronization [req-4e913ee6-ad90-4292-ad82-7300c41351b7 req-a71d18b2-f91d-4307-b180-6450ac3302e1 tempest-ServerMetadataNegativeTestJSON-872035205 tempest-ServerMetadataNegativeTestJSON-872035205-project-member] Enqueued Resource ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 with Priority: HIGHEST for action security_group_members [ 926.756084] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 with Priority: HIGHEST for action security_group_members [ 926.756084] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f599cf2b-60b7-4420-ad22-ed55d836f3a9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.756084] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.756084] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.756691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.756691] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.756691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.756691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.756919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.756961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.757999] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f599cf2b-60b7-4420-ad22-ed55d836f3a9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.772761] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e81f8e0e-8756-4918-b89d-656b7e5ea30c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.773955] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.773955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.773955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.773955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.774338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.774338] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.774482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.774534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.775622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.775622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.775622] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c is going to be deleted. [ 926.779874] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.779874] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.780070] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.780070] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.780291] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.780403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.780889] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.780889] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.780889] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.781108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.781218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.781314] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5de81c0-7123-460c-83a6-919b0bf8e09a is going to be updated. [ 926.783897] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.783897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.783897] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.811579] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.811579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.811579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.811579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.813319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.813319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.818581] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.818735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.818812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.818978] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.819190] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.834303] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5de81c0-7123-460c-83a6-919b0bf8e09a in Status: IN_PROGRESS for 2s [ 927.034992] env[65136]: INFO networking_nsxv3.common.synchronization [None req-193873d0-3605-48bd-9817-30435c31c898 tempest-AttachVolumeNegativeTest-40195811 tempest-AttachVolumeNegativeTest-40195811-project-member] Enqueued Resource ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 with Priority: HIGHEST for action security_group_rules [ 927.035752] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 with Priority: HIGHEST for action security_group_rules [ 927.036188] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57f6caaf-dd2c-4608-8f49-775ef39e3893 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.036334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.036516] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.036884] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.036970] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57f6caaf-dd2c-4608-8f49-775ef39e3893',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.171199] env[65136]: INFO networking_nsxv3.common.synchronization [None req-c1f47015-d824-44ec-b363-79b79bdbc8ff tempest-AttachVolumeNegativeTest-40195811 tempest-AttachVolumeNegativeTest-40195811-project-member] Enqueued Resource ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 with Priority: HIGHEST for action security_group_rules [ 927.171670] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 with Priority: HIGHEST for action security_group_rules [ 927.171981] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57f6caaf-dd2c-4608-8f49-775ef39e3893 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.172131] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.263136] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.263136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.263136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.263136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.263136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.263136] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.263136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.263136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.263136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.263136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.263136] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 is going to be updated. [ 927.277101] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e81f8e0e-8756-4918-b89d-656b7e5ea30c: rpc.has_security_group_logging(os_id): False [ 927.283396] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b5de81c0-7123-460c-83a6-919b0bf8e09a: rpc.has_security_group_logging(os_id): False [ 927.287498] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.324034] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.324034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.324034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.324333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.324365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.324620] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.324725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.324805] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.324964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.325077] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.325193] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c is going to be created. [ 927.328494] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.328654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.328691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.328869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.328954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.329588] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.329588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.329588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.329588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.332967] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.332967] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5de81c0-7123-460c-83a6-919b0bf8e09a is going to be updated. [ 927.332967] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.332967] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.332967] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.332967] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.332967] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.351110] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 in Status: IN_PROGRESS for 2s [ 927.353999] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e81f8e0e-8756-4918-b89d-656b7e5ea30c], does not exist path=[/infra/domains/default/groups/e81f8e0e-8756-4918-b89d-656b7e5ea30c]."\n}' [ 927.354266] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e81f8e0e-8756-4918-b89d-656b7e5ea30c [ 927.354322] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 927.409305] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.409305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.409305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.409305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.409305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.411955] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.412101] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.412174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.412358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.413386] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.413642] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.413749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.413811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.413963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.414863] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.415112] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.415219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.415283] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.415431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.415506] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.415591] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e81f8e0e-8756-4918-b89d-656b7e5ea30c is going to be created. [ 927.429065] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5de81c0-7123-460c-83a6-919b0bf8e09a in Status: IN_PROGRESS for 2s [ 927.441093] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e81f8e0e-8756-4918-b89d-656b7e5ea30c], does not exist path=[/infra/domains/default/groups/e81f8e0e-8756-4918-b89d-656b7e5ea30c]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e81f8e0e-8756-4918-b89d-656b7e5ea30c [ 927.441093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e81f8e0e-8756-4918-b89d-656b7e5ea30c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.441093] env[65136]: Traceback (most recent call last): [ 927.441093] env[65136]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 927.441093] env[65136]: return func(*args, **kwargs) [ 927.441093] env[65136]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 927.441093] env[65136]: res.raise_for_status() [ 927.441093] env[65136]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 927.441093] env[65136]: raise HTTPError(http_error_msg, response=self) [ 927.441093] env[65136]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e81f8e0e-8756-4918-b89d-656b7e5ea30c [ 927.441093] env[65136]: During handling of the above exception, another exception occurred: [ 927.441093] env[65136]: Traceback (most recent call last): [ 927.441093] env[65136]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 927.441093] env[65136]: listener.cb(fileno) [ 927.441093] env[65136]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 927.441093] env[65136]: result = function(*args, **kwargs) [ 927.441093] env[65136]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 927.441093] env[65136]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 927.441093] env[65136]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 927.441093] env[65136]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 927.441093] env[65136]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 927.441093] env[65136]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 927.441093] env[65136]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 927.441093] env[65136]: res.raise_for_status() [ 927.441093] env[65136]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 927.441093] env[65136]: raise HTTPError(http_error_msg, response=self) [ 927.441093] env[65136]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e81f8e0e-8756-4918-b89d-656b7e5ea30c [ 927.441093] env[65136]: Removing descriptor: 21 [ 927.569238] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.569238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.569238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.569238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.569238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.569238] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 already deleted. [ 927.569238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.569238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.569238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.569238] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57f6caaf-dd2c-4608-8f49-775ef39e3893',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.790348] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.790603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.790728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.791014] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.791167] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.791318] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 927.831081] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.831502] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.831502] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.831635] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.831809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.855601] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 928.095678] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.095678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.095678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.095678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.095678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.095993] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 already deleted. [ 928.095993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.662603] env[65136]: INFO networking_nsxv3.common.synchronization [None req-5978bcde-db0e-43fa-96c3-3fc05dba610e None None] Enqueued Resource ID: 77f02f5a-e29a-47b7-91f7-eb73356b5c3c with Priority: HIGHEST for action port [ 928.663198] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77f02f5a-e29a-47b7-91f7-eb73356b5c3c with Priority: HIGHEST for action port [ 928.663531] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-77f02f5a-e29a-47b7-91f7-eb73356b5c3c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.663655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77f02f5a-e29a-47b7-91f7-eb73356b5c3c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.663723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77f02f5a-e29a-47b7-91f7-eb73356b5c3c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.663980] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77f02f5a-e29a-47b7-91f7-eb73356b5c3c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.664062] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77f02f5a-e29a-47b7-91f7-eb73356b5c3c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.845599] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b5de81c0-7123-460c-83a6-919b0bf8e09a in Status: SUCCESS [ 928.845941] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b5de81c0-7123-460c-83a6-919b0bf8e09a deletion is rescheduled due to dependency. [ 928.845941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.167429] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77f02f5a-e29a-47b7-91f7-eb73356b5c3c [ 929.167429] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.167429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.167429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.167623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.167623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.167697] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77f02f5a-e29a-47b7-91f7-eb73356b5c3c already deleted. [ 929.167774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77f02f5a-e29a-47b7-91f7-eb73356b5c3c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.359808] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 in Status: SUCCESS [ 929.359927] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f599cf2b-60b7-4420-ad22-ed55d836f3a9 deletion is rescheduled due to dependency. [ 929.360148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f599cf2b-60b7-4420-ad22-ed55d836f3a9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.443035] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b5de81c0-7123-460c-83a6-919b0bf8e09a in Status: SUCCESS [ 929.443035] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.792332] env[65136]: INFO networking_nsxv3.common.synchronization [req-29e4c63e-6c66-4c81-bfc3-33ef390d28c5 req-c700cb4a-9c42-44ec-befc-c53baa082101 tempest-DeleteServersTestJSON-1045367082 tempest-DeleteServersTestJSON-1045367082-project-member] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 929.793105] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 929.793293] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.793477] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.793578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.793867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.794047] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.795022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.795022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.795022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.795022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.795022] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.866090] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 929.866354] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.866467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.866671] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.866861] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.866979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.867162] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.867341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.867510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.867510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.867640] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.867752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.867808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.867916] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.868065] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.868161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.868221] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.868354] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.868427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.868512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.868602] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.116128] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.116374] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.116501] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.117136] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.117136] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.117304] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.117346] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.117542] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.117695] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.117969] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.118112] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.118225] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.118331] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.118439] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.118542] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.118672] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.138650] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.138828] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.138968] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.139197] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.139536] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-6af72c04-f284-4abb-811e-53f789ec367f taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.139695] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-6af72c04-f284-4abb-811e-53f789ec367f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.139801] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-6af72c04-f284-4abb-811e-53f789ec367f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.140943] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-6af72c04-f284-4abb-811e-53f789ec367f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.140943] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6af72c04-f284-4abb-811e-53f789ec367f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.298015] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.371058] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 614443cd-8cb8-47ec-8a41-58ab513d082d: rpc.has_security_group_logging(os_id): False [ 930.390483] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.390706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.390706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.390877] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.420468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.420764] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.420961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.421042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.421364] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.421450] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.421648] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.421757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.421803] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.421952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.422052] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.422232] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.422369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.422369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.422808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.422808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.422808] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 930.542026] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.542026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.542288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.542360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.542608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.561658] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 930.643235] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.643594] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.643644] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.643930] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.644095] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.644256] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 6af72c04-f284-4abb-811e-53f789ec367f not found, creating... [ 930.644527] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.644699] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.644817] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.645059] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.645201] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.645483] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.645638] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.645753] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.645963] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.646107] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.646251] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 6af72c04-f284-4abb-811e-53f789ec367f is going to be created. [ 930.673403] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.673611] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.673726] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.673993] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.674393] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.674492] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-6af72c04-f284-4abb-811e-53f789ec367f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.800667] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.306305] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.306305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.306305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.306305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.306305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.306305] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 931.342569] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.342569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.342569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.342848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.342932] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.356383] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 931.425157] env[65136]: INFO networking_nsxv3.common.synchronization [req-29e4c63e-6c66-4c81-bfc3-33ef390d28c5 req-5db29566-8853-47be-acf5-11d59ded4a70 service nova] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_rules [ 931.425341] env[65136]: INFO networking_nsxv3.common.synchronization [req-29e4c63e-6c66-4c81-bfc3-33ef390d28c5 req-5db29566-8853-47be-acf5-11d59ded4a70 service nova] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 931.425479] env[65136]: INFO networking_nsxv3.common.synchronization [req-29e4c63e-6c66-4c81-bfc3-33ef390d28c5 req-5db29566-8853-47be-acf5-11d59ded4a70 service nova] Enqueued Resource ID: 6af72c04-f284-4abb-811e-53f789ec367f with Priority: HIGHEST for action port [ 931.425705] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_rules [ 931.425833] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 931.425931] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6af72c04-f284-4abb-811e-53f789ec367f with Priority: HIGHEST for action port [ 931.426484] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.426608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.426674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.426869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.426964] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.427829] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.427925] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.428129] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-6af72c04-f284-4abb-811e-53f789ec367f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.428224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6af72c04-f284-4abb-811e-53f789ec367f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.428288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6af72c04-f284-4abb-811e-53f789ec367f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.428446] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6af72c04-f284-4abb-811e-53f789ec367f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.428517] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6af72c04-f284-4abb-811e-53f789ec367f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.930356] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.930514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.933316] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6af72c04-f284-4abb-811e-53f789ec367f with status ACTIVE [ 931.933559] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.933697] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.933763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.933977] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.934081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.934267] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.934426] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.934426] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.934581] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.934660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.934837] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.934929] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.934989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.935171] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.935226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.935308] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6af72c04-f284-4abb-811e-53f789ec367f is going to be updated. [ 931.957511] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.957643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.957930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.957930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.958035] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.958198] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6af72c04-f284-4abb-811e-53f789ec367f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.582397] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 932.582761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.366315] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 933.368990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.368990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.368990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.368990] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.368990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.368990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.368990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.368990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.368990] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.870441] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.268853] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-84 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.269177] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-84" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.269349] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-84" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.269625] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-84" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.269981] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.270097] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.270184] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.270401] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.270545] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.270801] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.270922] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.271219] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.271219] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.271323] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.271380] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.271516] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.291688] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.291901] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 934.292150] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.292344] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-84" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.292712] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-996df4ad-51a1-47c4-8d2b-6daa140949d7 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.292920] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.293098] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.293830] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.293830] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('996df4ad-51a1-47c4-8d2b-6daa140949d7',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.375907] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.797690] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.797690] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.797690] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.797690] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.798333] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.800311] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.800311] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.800311] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.800311] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.800311] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.801693] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.801693] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.801693] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.802036] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.802273] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.802584] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 996df4ad-51a1-47c4-8d2b-6daa140949d7 is going to be updated. [ 934.830590] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.830801] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.830965] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.831290] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.831927] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.832045] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.878668] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.879075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.879075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.879205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.879353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.879460] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 934.918280] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.918463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.918558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.918788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.918940] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.930221] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 935.648681] env[65136]: INFO networking_nsxv3.common.synchronization [req-481e6d10-3910-4148-b79f-60f2d67f370c req-1889c156-6de0-4987-80d9-d49287ff080b service nova] Enqueued Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_rules [ 935.648862] env[65136]: INFO networking_nsxv3.common.synchronization [req-481e6d10-3910-4148-b79f-60f2d67f370c req-1889c156-6de0-4987-80d9-d49287ff080b service nova] Enqueued Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_members [ 935.649309] env[65136]: INFO networking_nsxv3.common.synchronization [req-481e6d10-3910-4148-b79f-60f2d67f370c req-1889c156-6de0-4987-80d9-d49287ff080b service nova] Enqueued Resource ID: 996df4ad-51a1-47c4-8d2b-6daa140949d7 with Priority: HIGHEST for action port [ 935.649997] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_rules [ 935.650263] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_members [ 935.650507] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 996df4ad-51a1-47c4-8d2b-6daa140949d7 with Priority: HIGHEST for action port [ 935.650865] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.651108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.651161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.651445] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.651492] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.652505] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.652656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.652748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.652966] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.653205] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.653365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.653463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.653663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.653826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.653964] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.655622] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-996df4ad-51a1-47c4-8d2b-6daa140949d7 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.655622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.655622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.655622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.655622] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('996df4ad-51a1-47c4-8d2b-6daa140949d7',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.157309] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.157741] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.157926] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.159010] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 996df4ad-51a1-47c4-8d2b-6daa140949d7 with status ACTIVE [ 936.159455] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.159687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.159839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.160125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.160369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.160615] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.160827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.160946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.161486] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.161646] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.161795] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.161908] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.161965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.162162] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.162247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.162433] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 996df4ad-51a1-47c4-8d2b-6daa140949d7 is going to be updated. [ 936.189683] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.190032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.190032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.190449] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.190691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.191021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-996df4ad-51a1-47c4-8d2b-6daa140949d7" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.664399] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.941030] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 936.941335] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.941937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.942172] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.942376] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.942498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.942564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.942905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.943033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.943135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.943232] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.172112] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.172400] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.172458] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.172724] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.172806] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.173063] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b is going to be updated. [ 937.209818] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.210053] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.210129] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.211167] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.211167] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.223177] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: IN_PROGRESS for 2s [ 937.446019] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.446245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.446310] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.446545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.446720] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.446841] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.446940] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.447096] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.447183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.447304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.447441] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.450374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.450374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.450374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.450374] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.450374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.450374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.450374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.450374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.450374] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.450374] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.951519] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5ef8f7d-8350-4fe2-9bef-70ff70b5f141: rpc.has_security_group_logging(os_id): False [ 937.970739] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.970739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.970739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.970739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.993261] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.993261] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.993261] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.993261] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.993674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.993674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.993674] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.994503] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.994503] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.994503] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.994503] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.994503] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.994503] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.994503] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.994788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.994788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.994788] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 938.064525] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.064525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.064525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.064525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.064525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.082117] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 939.236360] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: SUCCESS [ 939.236607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.236773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.237133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.237381] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.237466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.237539] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.237713] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.237797] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.237933] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.238088] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.741303] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.741508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.741545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.741840] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.742041] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.742146] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.742229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.742409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.742497] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.742583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.742731] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.742821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.742879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.743019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.743185] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.743316] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.743346] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.743484] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.743559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.743642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.743750] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.100032] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 940.100032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.247253] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b: rpc.has_security_group_logging(os_id): False [ 940.268833] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.268943] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.268995] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.269349] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.291434] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.291588] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.291716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.291790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.291937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.292027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.292234] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.292339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.292445] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.292518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.292591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.293063] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.293063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.293063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.293331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.293331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.293331] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b is going to be updated. [ 940.366063] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.366276] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.366342] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.366582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.366765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.385333] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: IN_PROGRESS for 2s [ 940.652443] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 940.652530] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 940.673948] env[65136]: INFO networking_nsxv3.common.synchronization [req-dd653f54-73d9-46ce-b84d-b76c3fc68d0a req-d4f8af85-9748-495c-bde0-109c8d410728 tempest-ServersAdminTestJSON-92432023 tempest-ServersAdminTestJSON-92432023-project-member] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 940.674804] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGHEST for action security_group_members [ 940.674804] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.675009] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.675009] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.676247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.676421] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.676527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.676591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.677150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.677254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.677344] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.180223] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.180409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.180409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.180659] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.203307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.203508] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.203609] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.203670] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.203876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.203932] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.204092] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be updated. [ 941.236901] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.236901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.236901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.236901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.236901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.246324] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: IN_PROGRESS for 2s [ 941.283846] env[65136]: INFO networking_nsxv3.common.synchronization [req-e1402243-1936-45aa-8b96-0ca3be73caa2 req-9642a549-ec71-4951-96c2-8e0c1c8ebe55 tempest-ServersTestJSON-425456513 tempest-ServersTestJSON-425456513-project-member] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 941.284309] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 941.284620] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.284762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.284816] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.284993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.285158] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.285282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.285333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.285449] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.285533] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.285667] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.668871] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.669160] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.669350] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.669796] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.669865] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.669965] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.670138] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.670404] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.670568] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.670779] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.670892] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.671075] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.671163] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.671351] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.671458] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.671593] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.692247] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.692531] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 941.692704] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.692924] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.693218] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-da631761-d630-4fbd-b7c9-e918a2b725c4 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.693395] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-da631761-d630-4fbd-b7c9-e918a2b725c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.693535] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-da631761-d630-4fbd-b7c9-e918a2b725c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.693862] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-da631761-d630-4fbd-b7c9-e918a2b725c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.694041] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da631761-d630-4fbd-b7c9-e918a2b725c4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.787486] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.200348] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.200348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.200348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.200348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.200348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.200348] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port da631761-d630-4fbd-b7c9-e918a2b725c4 not found, creating... [ 942.200348] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.200348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.200348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.200348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.200348] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.200828] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.200828] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.200828] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.200828] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.201988] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.201988] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: da631761-d630-4fbd-b7c9-e918a2b725c4 is going to be created. [ 942.228382] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.228675] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.228818] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.229116] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.229362] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.229617] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-da631761-d630-4fbd-b7c9-e918a2b725c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.290720] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.406787] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: SUCCESS [ 942.407124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.794671] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.794901] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.795118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.795454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.795514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.795632] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 942.847435] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.847435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.847435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.847623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.847754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.858248] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 942.964809] env[65136]: INFO networking_nsxv3.common.synchronization [req-e1402243-1936-45aa-8b96-0ca3be73caa2 req-105018d8-9b1a-4dc0-8540-62ceb22ef86f service nova] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_rules [ 942.965171] env[65136]: INFO networking_nsxv3.common.synchronization [req-e1402243-1936-45aa-8b96-0ca3be73caa2 req-105018d8-9b1a-4dc0-8540-62ceb22ef86f service nova] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 942.965171] env[65136]: INFO networking_nsxv3.common.synchronization [req-e1402243-1936-45aa-8b96-0ca3be73caa2 req-105018d8-9b1a-4dc0-8540-62ceb22ef86f service nova] Enqueued Resource ID: da631761-d630-4fbd-b7c9-e918a2b725c4 with Priority: HIGHEST for action port [ 942.965734] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_rules [ 942.965872] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 942.965968] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da631761-d630-4fbd-b7c9-e918a2b725c4 with Priority: HIGHEST for action port [ 942.966415] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.966564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.967025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.967025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.967025] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.967993] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.968133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.968951] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-da631761-d630-4fbd-b7c9-e918a2b725c4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.968951] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da631761-d630-4fbd-b7c9-e918a2b725c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.968951] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da631761-d630-4fbd-b7c9-e918a2b725c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.968951] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da631761-d630-4fbd-b7c9-e918a2b725c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.968951] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da631761-d630-4fbd-b7c9-e918a2b725c4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.259346] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 171f535d-ebee-432f-b393-d063259af9b9 in Status: SUCCESS [ 943.259346] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 171f535d-ebee-432f-b393-d063259af9b9 deletion is rescheduled due to dependency. [ 943.259571] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.471732] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da631761-d630-4fbd-b7c9-e918a2b725c4 with status ACTIVE [ 943.472052] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.472126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.472232] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.472409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.472495] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.472673] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.472769] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.472863] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.473036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.473117] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.473307] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.473419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.473482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.473641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.473717] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.473802] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da631761-d630-4fbd-b7c9-e918a2b725c4 is going to be updated. [ 943.475138] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.475311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.501426] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.501633] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.501710] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.501956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.502090] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.502236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da631761-d630-4fbd-b7c9-e918a2b725c4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.871149] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 944.871149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.871580] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.871626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.871809] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.872039] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.872039] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.872774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.872774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.872774] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.931698] env[65136]: INFO networking_nsxv3.common.synchronization [req-cb6444ca-3e75-4cbc-81b1-2f1b0d9d56e2 req-aa53abf0-e0e2-4f45-bb7f-24578a5ac033 tempest-ServerRescueNegativeTestJSON-1746403212 tempest-ServerRescueNegativeTestJSON-1746403212-project-member] Enqueued Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_members [ 944.932520] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_members [ 944.932603] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e076b0f0-4401-42ce-b608-41c3e6db24f9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.932730] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.932797] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.933065] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.933240] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.933380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.933450] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.933602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.933686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.933784] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.319019] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.319211] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-380" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.319369] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-380" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.319726] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-380" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.321313] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.321563] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.321790] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.322165] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.322424] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.322816] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.322998] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.323257] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.323935] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.323935] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.323935] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.324602] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.345045] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.345045] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 945.345045] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.345271] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-380" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.345497] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-60f6b0a9-1cfb-4269-97d7-eb972325f8e4 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.345698] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-60f6b0a9-1cfb-4269-97d7-eb972325f8e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.345835] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-60f6b0a9-1cfb-4269-97d7-eb972325f8e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.346278] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-60f6b0a9-1cfb-4269-97d7-eb972325f8e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.346889] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60f6b0a9-1cfb-4269-97d7-eb972325f8e4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.374730] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.436437] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.436582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.436652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.436885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.436978] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.438368] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.438368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.438368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.438368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.438368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.438368] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 already deleted. [ 945.438368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.851983] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.851983] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.851983] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.851983] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.851983] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.852254] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 60f6b0a9-1cfb-4269-97d7-eb972325f8e4 not found, creating... [ 945.852346] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.852502] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.852626] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.852828] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.852964] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.853768] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.853768] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.853768] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.853768] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.853963] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.853963] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 60f6b0a9-1cfb-4269-97d7-eb972325f8e4 is going to be created. [ 945.875341] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.875616] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.875662] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.875930] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.876188] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.876419] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-60f6b0a9-1cfb-4269-97d7-eb972325f8e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.878983] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.046584] env[65136]: INFO networking_nsxv3.common.synchronization [req-09ac66b1-1f5a-465b-8a8b-f81baf479812 req-4d3a0bd7-6a55-4d40-818a-6f545af0afa2 tempest-DeleteServersTestJSON-1045367082 tempest-DeleteServersTestJSON-1045367082-project-member] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 946.046584] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 946.046584] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.046584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.046584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.046899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.047052] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.047215] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.047291] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.047486] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.047581] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.047677] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.382969] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.383684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.383684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.383684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.383684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.383684] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 946.420033] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.420222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.420286] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.420498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.420649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.432522] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 946.550062] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.631718] env[65136]: INFO networking_nsxv3.common.synchronization [req-cb6444ca-3e75-4cbc-81b1-2f1b0d9d56e2 req-5acce796-fe54-40da-954e-49c3fdf578ea service nova] Enqueued Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_rules [ 946.631871] env[65136]: INFO networking_nsxv3.common.synchronization [req-cb6444ca-3e75-4cbc-81b1-2f1b0d9d56e2 req-5acce796-fe54-40da-954e-49c3fdf578ea service nova] Enqueued Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_members [ 946.632025] env[65136]: INFO networking_nsxv3.common.synchronization [req-cb6444ca-3e75-4cbc-81b1-2f1b0d9d56e2 req-5acce796-fe54-40da-954e-49c3fdf578ea service nova] Enqueued Resource ID: 60f6b0a9-1cfb-4269-97d7-eb972325f8e4 with Priority: HIGHEST for action port [ 946.632597] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_rules [ 946.632885] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_members [ 946.633028] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60f6b0a9-1cfb-4269-97d7-eb972325f8e4 with Priority: HIGHEST for action port [ 946.633589] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e076b0f0-4401-42ce-b608-41c3e6db24f9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.633589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.633589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.633881] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.633936] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.635538] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e076b0f0-4401-42ce-b608-41c3e6db24f9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.635707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.635755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.635926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.638041] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.638041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.638041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.638041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.638041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.638041] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.638041] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-60f6b0a9-1cfb-4269-97d7-eb972325f8e4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.638041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60f6b0a9-1cfb-4269-97d7-eb972325f8e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.638041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60f6b0a9-1cfb-4269-97d7-eb972325f8e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.638041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60f6b0a9-1cfb-4269-97d7-eb972325f8e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.638041] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60f6b0a9-1cfb-4269-97d7-eb972325f8e4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.053613] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.140664] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.141637] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60f6b0a9-1cfb-4269-97d7-eb972325f8e4 with status ACTIVE [ 947.141914] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.141983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.142024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.142223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.143836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.143836] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.143836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.143836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.144314] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.144314] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.144314] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.144457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.144457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.144582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.144652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.144758] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60f6b0a9-1cfb-4269-97d7-eb972325f8e4 is going to be updated. [ 947.145929] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e076b0f0-4401-42ce-b608-41c3e6db24f9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.146054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.168021] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.168021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.168021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.168253] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.168399] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.168555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60f6b0a9-1cfb-4269-97d7-eb972325f8e4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.557494] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.557494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.557494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.557494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.557494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.557494] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 947.587121] env[65136]: INFO networking_nsxv3.common.synchronization [req-aebdaba7-58da-4659-9131-6e73493b7fcd req-238467f5-32da-42f0-a2fe-be8a92b0d58d tempest-ServerRescueNegativeTestJSON-1746403212 tempest-ServerRescueNegativeTestJSON-1746403212-project-member] Enqueued Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_members [ 947.588602] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.588787] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.588866] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.589134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.589294] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.590823] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_members [ 947.591231] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e076b0f0-4401-42ce-b608-41c3e6db24f9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.591327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.601890] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 947.647984] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.914035] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.914035] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-380" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.914035] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-380" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.914035] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-380" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.914035] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.914035] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.915019] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.915252] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.915512] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.915863] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.916078] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.916273] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.916461] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.916647] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.916820] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.917134] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.939185] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.939185] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 947.939185] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.939185] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-380" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.939185] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-606eb919-6c5d-4bff-9317-06b0a798a975 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.939185] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-606eb919-6c5d-4bff-9317-06b0a798a975" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.939185] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-606eb919-6c5d-4bff-9317-06b0a798a975" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.939570] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-606eb919-6c5d-4bff-9317-06b0a798a975" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.939650] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('606eb919-6c5d-4bff-9317-06b0a798a975',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.150391] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.150782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.150782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.150782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.150915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.150980] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 is going to be created. [ 948.175434] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.175658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.175658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.175842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.175999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.187261] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 in Status: UNINITIALIZED for 2s [ 948.442994] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 948.443248] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.443835] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.444057] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.444224] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.444504] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.444652] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.444795] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 606eb919-6c5d-4bff-9317-06b0a798a975 not found, creating... [ 948.445057] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.445217] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.445335] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.445552] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.445685] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.445962] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.446132] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.446250] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.446449] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.446581] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.446718] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 606eb919-6c5d-4bff-9317-06b0a798a975 is going to be created. [ 948.448014] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.448183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.448345] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.448462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.448522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.448664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.448740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.448826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.448917] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.473204] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.473415] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.473540] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.473883] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.474178] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.474422] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-606eb919-6c5d-4bff-9317-06b0a798a975" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.954028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.954028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.954028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.954028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.954028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.954028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.954028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.954028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.954028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.954028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.954028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.954028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.954028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.955953] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.956586] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.957054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.957310] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.957714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.958511] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.958511] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.958728] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.219612] env[65136]: INFO networking_nsxv3.common.synchronization [req-aebdaba7-58da-4659-9131-6e73493b7fcd req-8db0a282-327b-47b4-901c-9fb144f5806b service nova] Enqueued Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_rules [ 949.219612] env[65136]: INFO networking_nsxv3.common.synchronization [req-aebdaba7-58da-4659-9131-6e73493b7fcd req-8db0a282-327b-47b4-901c-9fb144f5806b service nova] Enqueued Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_members [ 949.219612] env[65136]: INFO networking_nsxv3.common.synchronization [req-aebdaba7-58da-4659-9131-6e73493b7fcd req-8db0a282-327b-47b4-901c-9fb144f5806b service nova] Enqueued Resource ID: 606eb919-6c5d-4bff-9317-06b0a798a975 with Priority: HIGHEST for action port [ 949.219612] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_rules [ 949.219612] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_members [ 949.221426] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 606eb919-6c5d-4bff-9317-06b0a798a975 with Priority: HIGHEST for action port [ 949.221936] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e076b0f0-4401-42ce-b608-41c3e6db24f9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.222952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.222952] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e076b0f0-4401-42ce-b608-41c3e6db24f9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.223331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.224016] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-606eb919-6c5d-4bff-9317-06b0a798a975 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.224172] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-606eb919-6c5d-4bff-9317-06b0a798a975" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.224947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-606eb919-6c5d-4bff-9317-06b0a798a975" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.224947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-606eb919-6c5d-4bff-9317-06b0a798a975" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.224947] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('606eb919-6c5d-4bff-9317-06b0a798a975',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.461859] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a99f7e35-ad71-4640-a081-3c507e997901: rpc.has_security_group_logging(os_id): False [ 949.479862] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.480136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.480136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.480760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.499791] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.500075] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.500192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.500249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.500768] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.500768] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.500768] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.500981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.500981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.501159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.501159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.501377] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.501491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.501933] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.501933] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.501933] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.501933] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 949.567437] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.567652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.567735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.567954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.568122] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.582657] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 949.611767] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 949.612024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.731531] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 606eb919-6c5d-4bff-9317-06b0a798a975 with status ACTIVE [ 949.731636] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.731793] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.731869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.732171] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.732280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.732505] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.732632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.732697] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.732878] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.732967] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.733220] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.733347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.733422] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.733633] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.733741] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.733845] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 606eb919-6c5d-4bff-9317-06b0a798a975 is going to be updated. [ 949.759948] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.760085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.760085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.760342] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.760480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.760649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-606eb919-6c5d-4bff-9317-06b0a798a975" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.198046] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 in Status: SUCCESS [ 950.198332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.198555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.198870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.199163] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.199307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.199392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.199595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.199707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.199809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.199939] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.200927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.201150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.201319] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.201471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.201532] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.201720] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.201811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.201921] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.704014] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e076b0f0-4401-42ce-b608-41c3e6db24f9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.704503] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.706079] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.208630] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.597053] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 951.597360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.711427] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.711427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.711427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.711427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.711427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.712163] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 is going to be updated. [ 951.747681] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.747930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.747930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.748141] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.748289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.760595] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 in Status: IN_PROGRESS for 2s [ 953.773230] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 in Status: SUCCESS [ 953.773565] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.773663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.773859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.774096] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.774702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.774702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.774702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.774702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.774702] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.222526] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 954.222526] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 954.279077] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.784978] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.289970] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.291062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.291062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.291062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.291062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.291062] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 is going to be updated. [ 955.324280] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.324420] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.324535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.324782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.324972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.337360] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 in Status: IN_PROGRESS for 2s [ 955.851519] env[65136]: INFO networking_nsxv3.common.synchronization [req-f795038f-7d68-4976-9cc1-a4ba622e9733 req-22ff40e3-9b59-44d4-9169-47ce64c934be tempest-ServersTestJSON-425456513 tempest-ServersTestJSON-425456513-project-member] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 955.851519] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 955.851811] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.851944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.852742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.852990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.853184] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.853309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.853389] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.853622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.853734] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.853831] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.357218] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.859081] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.863238] env[65136]: INFO networking_nsxv3.common.synchronization [req-24084afd-58be-4650-afdd-6867969a4cea req-2c45d84c-5247-4b0b-bf32-d5ab7f95bf26 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 with Priority: HIGHEST for action security_group_members [ 956.863379] env[65136]: INFO networking_nsxv3.common.synchronization [req-24084afd-58be-4650-afdd-6867969a4cea req-2c45d84c-5247-4b0b-bf32-d5ab7f95bf26 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 956.863509] env[65136]: INFO networking_nsxv3.common.synchronization [req-24084afd-58be-4650-afdd-6867969a4cea req-2c45d84c-5247-4b0b-bf32-d5ab7f95bf26 tempest-SecurityGroupsTestJSON-996945921 tempest-SecurityGroupsTestJSON-996945921-project-member] Enqueued Resource ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e with Priority: HIGHEST for action security_group_members [ 956.864027] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 with Priority: HIGHEST for action security_group_members [ 956.864172] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGHEST for action security_group_members [ 956.864266] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e with Priority: HIGHEST for action security_group_members [ 956.864549] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac3eebaf-da3a-488c-83dd-470138abdfc8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.864654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.864718] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.864918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.870264] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.870264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.870264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.870264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.870264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.870264] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac3eebaf-da3a-488c-83dd-470138abdfc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.871143] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.871255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.871320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.871506] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.871655] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.871747] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.871807] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.871948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.872116] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.872212] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.873556] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d34f355b-9e16-4e39-9a04-e9b1d96e578e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.873820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.873896] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.874063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.874209] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.874300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.874362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.874501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.874581] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.874863] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d34f355b-9e16-4e39-9a04-e9b1d96e578e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.352267] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 in Status: SUCCESS [ 957.352267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.352267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.352267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.352267] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.352267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.352267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.352267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.352267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.352267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.352267] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e076b0f0-4401-42ce-b608-41c3e6db24f9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.352267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.352267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.352267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.352267] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.352267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.352267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.352267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.352267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.352877] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.352877] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.362101] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.362287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.362388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.362616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.362696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.362777] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 957.377026] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.377026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.377026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.377026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.377685] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.377772] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.379941] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.379941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.394779] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.394966] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.395009] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.395249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.395406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.400270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.400509] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.400623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.400691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.400872] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.400955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.401055] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 is going to be updated. [ 957.401995] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.402183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.402271] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.402458] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.402628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.402628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.402783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.402817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.402896] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be updated. [ 957.406426] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 957.406426] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.406426] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.424671] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.424886] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.424982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.425079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.425294] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.425380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.425593] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e is going to be updated. [ 957.438281] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.438490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.438490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.438701] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.438819] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.440770] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.440894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.440980] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.441176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.441315] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.451647] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: IN_PROGRESS for 2s [ 957.452414] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 in Status: IN_PROGRESS for 2s [ 957.456704] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.456704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.456704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.456704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.456704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.463745] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e in Status: IN_PROGRESS for 2s [ 957.856719] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e076b0f0-4401-42ce-b608-41c3e6db24f9: rpc.has_security_group_logging(os_id): False [ 957.875598] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.875915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.875915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.876136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.876136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.876340] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.876487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.876583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.876965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.876965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.877366] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.877473] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.877572] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.877801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.877915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.878219] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.878371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.878461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.878641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.878722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.878809] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 is going to be created. [ 957.944102] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.944498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.944776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.945107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.945180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.961870] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 in Status: IN_PROGRESS for 2s [ 958.995257] env[65136]: INFO networking_nsxv3.common.synchronization [req-d6bf3b5f-54cc-4a78-ba6c-75c4735f386a req-124479c8-a041-4963-86a6-8200ab90ac28 tempest-ImagesTestJSON-1051903205 tempest-ImagesTestJSON-1051903205-project-member] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 958.996601] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 958.997274] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.997664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.997945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.000087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.000087] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.000087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.000087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.000087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.000087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.000087] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.404785] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-63 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.404992] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.405182] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.405458] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.405743] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.405907] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.406243] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.406605] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.406752] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.406974] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.407185] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.407301] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.407410] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.407522] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.407624] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.407757] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.419754] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 959.420063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.431293] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.431594] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 959.431788] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.431986] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.432315] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-9be58bf2-33c1-4084-8b03-b7d9d537feb8 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.432492] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-9be58bf2-33c1-4084-8b03-b7d9d537feb8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.432625] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-9be58bf2-33c1-4084-8b03-b7d9d537feb8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.432950] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-9be58bf2-33c1-4084-8b03-b7d9d537feb8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.433130] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9be58bf2-33c1-4084-8b03-b7d9d537feb8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.463347] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 614443cd-8cb8-47ec-8a41-58ab513d082d in Status: SUCCESS [ 959.463528] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d deletion is rescheduled due to dependency. [ 959.463880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.464405] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 in Status: SUCCESS [ 959.464547] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac3eebaf-da3a-488c-83dd-470138abdfc8 deletion is rescheduled due to dependency. [ 959.464642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac3eebaf-da3a-488c-83dd-470138abdfc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.473706] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e in Status: SUCCESS [ 959.474493] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d34f355b-9e16-4e39-9a04-e9b1d96e578e deletion is rescheduled due to dependency. [ 959.474493] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d34f355b-9e16-4e39-9a04-e9b1d96e578e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.504558] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.936449] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.936643] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.936778] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.937099] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.937258] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.937440] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 9be58bf2-33c1-4084-8b03-b7d9d537feb8 not found, creating... [ 959.937712] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.937873] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.938035] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.938282] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.938630] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.938706] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.938860] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.938976] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.939242] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.939381] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.939527] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 9be58bf2-33c1-4084-8b03-b7d9d537feb8 is going to be created. [ 959.965749] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.965963] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.966118] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.966384] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.966611] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.966848] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-9be58bf2-33c1-4084-8b03-b7d9d537feb8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.975587] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 in Status: SUCCESS [ 959.975755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.975888] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.976113] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.976204] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.007136] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.479524] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e076b0f0-4401-42ce-b608-41c3e6db24f9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.479727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.479727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.479907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.480166] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.480666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.480666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.480666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.480779] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.481019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.481019] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.510482] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.510708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.510796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.510997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.511158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.511211] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 960.540880] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.541105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.541105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.541328] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.541481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.550654] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 960.698967] env[65136]: INFO networking_nsxv3.common.synchronization [req-d6bf3b5f-54cc-4a78-ba6c-75c4735f386a req-951a0e84-b863-41db-a2c2-bf5c4162a0cf service nova] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_rules [ 960.699203] env[65136]: INFO networking_nsxv3.common.synchronization [req-d6bf3b5f-54cc-4a78-ba6c-75c4735f386a req-951a0e84-b863-41db-a2c2-bf5c4162a0cf service nova] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 960.699361] env[65136]: INFO networking_nsxv3.common.synchronization [req-d6bf3b5f-54cc-4a78-ba6c-75c4735f386a req-951a0e84-b863-41db-a2c2-bf5c4162a0cf service nova] Enqueued Resource ID: 9be58bf2-33c1-4084-8b03-b7d9d537feb8 with Priority: HIGHEST for action port [ 960.699595] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_rules [ 960.699723] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 960.699883] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9be58bf2-33c1-4084-8b03-b7d9d537feb8 with Priority: HIGHEST for action port [ 960.700576] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.700672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.700743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.704079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.704079] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.704079] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.704079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.704079] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-9be58bf2-33c1-4084-8b03-b7d9d537feb8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.704079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9be58bf2-33c1-4084-8b03-b7d9d537feb8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.704079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9be58bf2-33c1-4084-8b03-b7d9d537feb8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.704079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9be58bf2-33c1-4084-8b03-b7d9d537feb8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.704079] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9be58bf2-33c1-4084-8b03-b7d9d537feb8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.984741] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e076b0f0-4401-42ce-b608-41c3e6db24f9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.984937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.984999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.985740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.985740] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.985740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.985740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.985740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.985740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.986043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.986043] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e076b0f0-4401-42ce-b608-41c3e6db24f9 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.986043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.986144] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.986224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.986357] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.986447] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.986507] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.986639] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.986714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.986840] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.986898] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.208879] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.208879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.208879] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9be58bf2-33c1-4084-8b03-b7d9d537feb8 with status ACTIVE [ 961.208879] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.208879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.208879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.208879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.208879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.208879] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.208879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.208879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.208879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.208879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.208879] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.210615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.210615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.210615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.210615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.210615] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9be58bf2-33c1-4084-8b03-b7d9d537feb8 is going to be updated. [ 961.236704] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.237107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.237107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.237240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.237375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.237578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9be58bf2-33c1-4084-8b03-b7d9d537feb8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.489677] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e076b0f0-4401-42ce-b608-41c3e6db24f9: rpc.has_security_group_logging(os_id): False [ 961.512419] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.512623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.512678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.513049] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.513049] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.513281] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.513382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.513446] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.513602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.513681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.513908] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.514031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.514095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.514246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.514346] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.514548] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.514641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.514703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.514839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.514918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.515010] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 is going to be updated. [ 961.591233] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.591233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.591233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.591233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.591233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.607070] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 in Status: IN_PROGRESS for 2s [ 962.563969] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 962.563969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.563969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.563969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.564455] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.564455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.564455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.564455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.564596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.564702] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.066562] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.532784] env[65136]: INFO networking_nsxv3.common.synchronization [req-1b9d6b24-96eb-4250-bcc1-3927fccc59d0 req-57e004f0-9214-45d9-a8ce-ee6a27d8da40 tempest-AttachVolumeNegativeTest-40195811 tempest-AttachVolumeNegativeTest-40195811-project-member] Enqueued Resource ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 with Priority: HIGHEST for action security_group_members [ 963.534698] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 with Priority: HIGHEST for action security_group_members [ 963.536945] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-57f6caaf-dd2c-4608-8f49-775ef39e3893 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.536945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.536945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.536945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.536945] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.536945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.536945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.536945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.536945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.536945] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57f6caaf-dd2c-4608-8f49-775ef39e3893',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.569451] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.621767] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 in Status: SUCCESS [ 963.622420] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.936026] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-525 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.936026] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-525" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.936026] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-525" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.936026] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-525" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.936026] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.936481] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.936717] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.937041] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.937323] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.937644] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.937899] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.938142] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.938397] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.938633] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.938841] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.940307] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.961973] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.961973] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 963.961973] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.961973] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-525" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.961973] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-1188d246-1b56-4645-92a3-8359f85b1e69 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.961973] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-1188d246-1b56-4645-92a3-8359f85b1e69" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.961973] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-1188d246-1b56-4645-92a3-8359f85b1e69" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.962354] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-1188d246-1b56-4645-92a3-8359f85b1e69" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.962354] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1188d246-1b56-4645-92a3-8359f85b1e69',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.041037] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.041206] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.041310] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.041560] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.041666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.041869] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.041983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.042062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.042217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.042319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.042455] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 already deleted. [ 964.042549] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.072309] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.072559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.072647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.072861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.072952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.073068] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 964.105907] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.106093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.106148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.106334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.106477] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.115218] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 964.465605] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.465605] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.465605] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.466085] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.466085] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.466085] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 1188d246-1b56-4645-92a3-8359f85b1e69 not found, creating... [ 964.466274] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.466442] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.466564] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.466887] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.466970] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.467221] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.467379] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.467495] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.467706] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.467839] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.468016] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 1188d246-1b56-4645-92a3-8359f85b1e69 is going to be created. [ 964.491403] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.491645] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.491782] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.492068] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.492347] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.492644] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-1188d246-1b56-4645-92a3-8359f85b1e69" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.290023] env[65136]: INFO networking_nsxv3.common.synchronization [req-1b9d6b24-96eb-4250-bcc1-3927fccc59d0 req-1187d384-d55c-4530-9935-d88c2e1ebd71 service nova] Enqueued Resource ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 with Priority: HIGHEST for action security_group_rules [ 965.290544] env[65136]: INFO networking_nsxv3.common.synchronization [req-1b9d6b24-96eb-4250-bcc1-3927fccc59d0 req-1187d384-d55c-4530-9935-d88c2e1ebd71 service nova] Enqueued Resource ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 with Priority: HIGHEST for action security_group_members [ 965.290544] env[65136]: INFO networking_nsxv3.common.synchronization [req-1b9d6b24-96eb-4250-bcc1-3927fccc59d0 req-1187d384-d55c-4530-9935-d88c2e1ebd71 service nova] Enqueued Resource ID: 1188d246-1b56-4645-92a3-8359f85b1e69 with Priority: HIGHEST for action port [ 965.291174] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 with Priority: HIGHEST for action security_group_rules [ 965.291311] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 with Priority: HIGHEST for action security_group_members [ 965.291373] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1188d246-1b56-4645-92a3-8359f85b1e69 with Priority: HIGHEST for action port [ 965.291693] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57f6caaf-dd2c-4608-8f49-775ef39e3893 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.291830] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.291905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.292152] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.292248] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57f6caaf-dd2c-4608-8f49-775ef39e3893',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.293296] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-57f6caaf-dd2c-4608-8f49-775ef39e3893 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.293423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.293478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.293681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.294017] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.294105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.294258] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.294320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.294380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.294597] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57f6caaf-dd2c-4608-8f49-775ef39e3893',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.301387] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-1188d246-1b56-4645-92a3-8359f85b1e69 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.301656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1188d246-1b56-4645-92a3-8359f85b1e69" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.302875] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1188d246-1b56-4645-92a3-8359f85b1e69" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.302875] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1188d246-1b56-4645-92a3-8359f85b1e69" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.302875] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1188d246-1b56-4645-92a3-8359f85b1e69',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.584024] env[65136]: INFO networking_nsxv3.common.synchronization [None req-d6e588c3-b688-40d1-aff5-2024026191a0 None None] Enqueued Resource ID: d91114f1-3595-46e9-b2bd-760f314eb362 with Priority: HIGHEST for action port [ 965.584309] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d91114f1-3595-46e9-b2bd-760f314eb362 with Priority: HIGHEST for action port [ 965.584793] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-d91114f1-3595-46e9-b2bd-760f314eb362 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.585016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d91114f1-3595-46e9-b2bd-760f314eb362" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.585169] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d91114f1-3595-46e9-b2bd-760f314eb362" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.585808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d91114f1-3595-46e9-b2bd-760f314eb362" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.585808] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d91114f1-3595-46e9-b2bd-760f314eb362',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.803087] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57f6caaf-dd2c-4608-8f49-775ef39e3893',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.806736] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-57f6caaf-dd2c-4608-8f49-775ef39e3893 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.806736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.806736] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1188d246-1b56-4645-92a3-8359f85b1e69 with status ACTIVE [ 965.806736] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.806736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.806736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.806736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.806736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.806736] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.806736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.806736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.806736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.806736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.806736] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.807363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.807363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.807363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.807363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.807363] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1188d246-1b56-4645-92a3-8359f85b1e69 is going to be updated. [ 965.832185] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.832185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.832452] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.832452] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.832575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.832728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1188d246-1b56-4645-92a3-8359f85b1e69" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.092447] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d91114f1-3595-46e9-b2bd-760f314eb362 [ 966.092772] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.092952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.093030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.093254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.093344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.093453] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d91114f1-3595-46e9-b2bd-760f314eb362 already deleted. [ 966.093531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d91114f1-3595-46e9-b2bd-760f314eb362" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.127814] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 966.127814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.127814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.127814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.128347] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.128347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.128347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.128347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.128515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.128515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.128576] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.312210] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57f6caaf-dd2c-4608-8f49-775ef39e3893',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.576945] env[65136]: INFO networking_nsxv3.common.synchronization [None req-a9502fc8-6189-4b83-92ce-eb870569659e tempest-AttachVolumeTestJSON-333791645 tempest-AttachVolumeTestJSON-333791645-project-member] Enqueued Resource ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c with Priority: HIGHEST for action security_group_rules [ 966.577730] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c with Priority: HIGHEST for action security_group_rules [ 966.580160] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a9a81b8-cfea-4cf0-a7c1-6c152505127c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.580255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.580691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.580691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.580815] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a9a81b8-cfea-4cf0-a7c1-6c152505127c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.631582] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.631779] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.631955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.632202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.632391] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.632508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.632571] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.632792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.632907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.633048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.633279] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.633410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.633527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.633718] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.633944] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.634095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.634170] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.634379] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.634468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.634535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.634628] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.689948] env[65136]: INFO networking_nsxv3.common.synchronization [None req-18a4b63b-892d-4dcc-a70f-56dd40c69c94 tempest-AttachVolumeTestJSON-333791645 tempest-AttachVolumeTestJSON-333791645-project-member] Enqueued Resource ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c with Priority: HIGHEST for action security_group_rules [ 966.690559] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c with Priority: HIGHEST for action security_group_rules [ 966.690952] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a9a81b8-cfea-4cf0-a7c1-6c152505127c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.690952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.818204] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.818204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.818204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.818204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.818204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.818493] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 is going to be created. [ 966.852364] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.852364] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.852364] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.852364] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.852703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.866399] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 in Status: UNINITIALIZED for 2s [ 967.107357] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.107555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.107603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.107819] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.107913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.108035] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c already deleted. [ 967.108134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.108345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.108577] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.108682] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a9a81b8-cfea-4cf0-a7c1-6c152505127c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.138029] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15: rpc.has_security_group_logging(os_id): False [ 967.160149] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.160466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.160466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.160825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.185200] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.185200] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.185200] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.185200] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.185660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.185660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.185660] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.185952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.185952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.186185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.186185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.186496] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.186496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.186636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.186827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.186880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.187012] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 967.391289] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.391289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.391683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.391683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.391880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.406792] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 967.633371] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.633522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.633577] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.633889] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.633984] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.634098] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c already deleted. [ 967.634182] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.009074] env[65136]: INFO networking_nsxv3.common.synchronization [None req-6b18fbea-825d-486f-b9f8-806c7343ac28 None None] Enqueued Resource ID: d6d6dea8-d256-4be9-9332-1ddd1afd6858 with Priority: HIGHEST for action port [ 968.009756] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d6dea8-d256-4be9-9332-1ddd1afd6858 with Priority: HIGHEST for action port [ 968.010093] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6d6dea8-d256-4be9-9332-1ddd1afd6858 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.010287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6d6dea8-d256-4be9-9332-1ddd1afd6858" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.010378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6d6dea8-d256-4be9-9332-1ddd1afd6858" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.010798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6d6dea8-d256-4be9-9332-1ddd1afd6858" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.010892] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6d6dea8-d256-4be9-9332-1ddd1afd6858',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.513011] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6d6dea8-d256-4be9-9332-1ddd1afd6858 [ 968.513297] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.513377] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.513414] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.513627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.513721] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.513889] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6d6dea8-d256-4be9-9332-1ddd1afd6858 already deleted. [ 968.513982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6d6dea8-d256-4be9-9332-1ddd1afd6858" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.878724] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 in Status: SUCCESS [ 968.878977] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.879219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.879427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.879652] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.879769] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.879851] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.879985] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.880080] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.880171] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.880330] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57f6caaf-dd2c-4608-8f49-775ef39e3893',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.229867] env[65136]: INFO networking_nsxv3.common.synchronization [None req-7fa19a4f-2ea4-4335-9b02-113221601a9f None None] Enqueued Resource ID: c8a9b764-2124-4239-8a2e-f1a43ccd532b with Priority: HIGHEST for action port [ 969.230516] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8a9b764-2124-4239-8a2e-f1a43ccd532b with Priority: HIGHEST for action port [ 969.231262] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8a9b764-2124-4239-8a2e-f1a43ccd532b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.231262] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8a9b764-2124-4239-8a2e-f1a43ccd532b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.231262] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8a9b764-2124-4239-8a2e-f1a43ccd532b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.231446] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8a9b764-2124-4239-8a2e-f1a43ccd532b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.231446] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8a9b764-2124-4239-8a2e-f1a43ccd532b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.385824] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57f6caaf-dd2c-4608-8f49-775ef39e3893',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.424908] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 969.425156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.734991] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8a9b764-2124-4239-8a2e-f1a43ccd532b [ 969.735377] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.735631] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.735766] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.736061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.736199] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.736315] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8a9b764-2124-4239-8a2e-f1a43ccd532b already deleted. [ 969.736400] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8a9b764-2124-4239-8a2e-f1a43ccd532b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.888638] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57f6caaf-dd2c-4608-8f49-775ef39e3893: rpc.has_security_group_logging(os_id): False [ 969.909472] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.909662] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.909662] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.909919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.910032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.910435] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.910435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.910435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.910592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.910680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.910799] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 is going to be created. [ 969.979840] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.980051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.980051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.980284] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.980464] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.994447] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 in Status: IN_PROGRESS for 2s [ 970.260804] env[65136]: INFO networking_nsxv3.common.synchronization [None req-bef39fcc-111f-43a1-b963-f1ffd44fbd6d tempest-AttachVolumeShelveTestJSON-1302323664 tempest-AttachVolumeShelveTestJSON-1302323664-project-member] Enqueued Resource ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c with Priority: HIGHEST for action security_group_rules [ 970.261589] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c with Priority: HIGHEST for action security_group_rules [ 970.261908] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.262542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.262542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.262542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.262705] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.395964] env[65136]: INFO networking_nsxv3.common.synchronization [None req-cc969031-39f7-428e-9d19-edfd97d6f406 tempest-AttachVolumeShelveTestJSON-1302323664 tempest-AttachVolumeShelveTestJSON-1302323664-project-member] Enqueued Resource ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c with Priority: HIGHEST for action security_group_rules [ 970.397671] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c with Priority: HIGHEST for action security_group_rules [ 970.397671] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.397671] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.793110] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.793110] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.793552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.793552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.793899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.795637] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c already deleted. [ 970.795637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.795637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.795637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.795637] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.324369] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.324369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.324369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.324369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.324369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.327945] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c already deleted. [ 971.327945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.404311] env[65136]: INFO networking_nsxv3.common.synchronization [None req-7abc1290-3608-4054-b239-ef0cc3f74a76 tempest-ServerDiskConfigTestJSON-1818502390 tempest-ServerDiskConfigTestJSON-1818502390-project-member] Enqueued Resource ID: ea53f482-7674-4812-b452-95b5d881552f with Priority: HIGHEST for action security_group_rules [ 971.404972] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea53f482-7674-4812-b452-95b5d881552f with Priority: HIGHEST for action security_group_rules [ 971.405724] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea53f482-7674-4812-b452-95b5d881552f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.406334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea53f482-7674-4812-b452-95b5d881552f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.406753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea53f482-7674-4812-b452-95b5d881552f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.407612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea53f482-7674-4812-b452-95b5d881552f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.407750] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea53f482-7674-4812-b452-95b5d881552f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.549052] env[65136]: INFO networking_nsxv3.common.synchronization [None req-d4761ce1-a84c-466f-a58a-56d5957d7866 tempest-ServerDiskConfigTestJSON-1818502390 tempest-ServerDiskConfigTestJSON-1818502390-project-member] Enqueued Resource ID: ea53f482-7674-4812-b452-95b5d881552f with Priority: HIGHEST for action security_group_rules [ 971.549780] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea53f482-7674-4812-b452-95b5d881552f with Priority: HIGHEST for action security_group_rules [ 971.550855] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea53f482-7674-4812-b452-95b5d881552f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.550996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea53f482-7674-4812-b452-95b5d881552f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.755330] env[65136]: INFO networking_nsxv3.common.synchronization [None req-69eb702b-6875-4750-ae8e-83de0381e301 None None] Enqueued Resource ID: 56a6e053-c1fe-4209-b780-b8f4b400c733 with Priority: HIGHEST for action port [ 971.755869] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56a6e053-c1fe-4209-b780-b8f4b400c733 with Priority: HIGHEST for action port [ 971.756319] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-56a6e053-c1fe-4209-b780-b8f4b400c733 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.756471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56a6e053-c1fe-4209-b780-b8f4b400c733" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.756535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56a6e053-c1fe-4209-b780-b8f4b400c733" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.756831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56a6e053-c1fe-4209-b780-b8f4b400c733" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.756918] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56a6e053-c1fe-4209-b780-b8f4b400c733',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.933463] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.933463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.933463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.933463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.933463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.933463] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea53f482-7674-4812-b452-95b5d881552f already deleted. [ 971.933463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea53f482-7674-4812-b452-95b5d881552f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.933463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea53f482-7674-4812-b452-95b5d881552f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.933463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea53f482-7674-4812-b452-95b5d881552f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.933463] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea53f482-7674-4812-b452-95b5d881552f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.005306] env[65136]: INFO networking_nsxv3.common.synchronization [req-e3049c45-ce94-48f8-a329-f82144b770da req-9605230b-1128-4216-a895-c9963183ccbb tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 972.005513] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 972.005972] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.006277] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.006454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.006782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.007139] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.007403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.007562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.007816] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.007996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.008201] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.010151] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 in Status: SUCCESS [ 972.010666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.263418] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56a6e053-c1fe-4209-b780-b8f4b400c733 [ 972.263418] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.263418] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.263418] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.263418] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.263418] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.263418] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56a6e053-c1fe-4209-b780-b8f4b400c733 already deleted. [ 972.263418] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56a6e053-c1fe-4209-b780-b8f4b400c733" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.456321] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.456584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.456584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.456797] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.456919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.457088] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea53f482-7674-4812-b452-95b5d881552f already deleted. [ 972.457207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea53f482-7674-4812-b452-95b5d881552f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.512968] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.513174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.513213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.513514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.513611] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.513821] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.514045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.514045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.514181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.514254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.514367] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be deleted. [ 972.544776] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.544991] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.545060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.545270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.545369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.545472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.841962] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-998 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.842316] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.842480] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.842841] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.843232] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.843400] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.843526] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.843805] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.843955] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.844224] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.844395] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.844554] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.844696] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.844869] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.844937] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.845069] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.866191] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.866534] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 972.866864] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.867154] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.867689] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-33b8b996-f72b-4039-a3fe-becc7ef14192 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.867974] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-33b8b996-f72b-4039-a3fe-becc7ef14192" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.868228] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-33b8b996-f72b-4039-a3fe-becc7ef14192" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.868579] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-33b8b996-f72b-4039-a3fe-becc7ef14192" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.868974] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33b8b996-f72b-4039-a3fe-becc7ef14192',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.373422] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.373422] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.373422] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.373844] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.373844] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.373906] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 33b8b996-f72b-4039-a3fe-becc7ef14192 not found, creating... [ 973.374179] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.374416] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.374556] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.374778] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.374919] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.375221] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.375379] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.375494] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.375699] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.375829] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.375967] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 33b8b996-f72b-4039-a3fe-becc7ef14192 is going to be created. [ 973.399755] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.399957] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.400105] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.400447] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.400672] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.400897] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-33b8b996-f72b-4039-a3fe-becc7ef14192" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.776186] env[65136]: INFO networking_nsxv3.common.synchronization [None req-59345bdb-3767-4e74-8d40-4f6d0c054ceb None None] Enqueued Resource ID: dec263ea-c810-49ba-b197-517a944e2d17 with Priority: HIGHEST for action port [ 973.776881] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dec263ea-c810-49ba-b197-517a944e2d17 with Priority: HIGHEST for action port [ 973.776881] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-dec263ea-c810-49ba-b197-517a944e2d17 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.777126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dec263ea-c810-49ba-b197-517a944e2d17" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.777231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dec263ea-c810-49ba-b197-517a944e2d17" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.777701] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dec263ea-c810-49ba-b197-517a944e2d17" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.777701] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dec263ea-c810-49ba-b197-517a944e2d17',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.115278] env[65136]: INFO networking_nsxv3.common.synchronization [req-e3049c45-ce94-48f8-a329-f82144b770da req-cd49ee72-0885-4463-be6b-ccf4f054e562 service nova] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_rules [ 974.115465] env[65136]: INFO networking_nsxv3.common.synchronization [req-e3049c45-ce94-48f8-a329-f82144b770da req-cd49ee72-0885-4463-be6b-ccf4f054e562 service nova] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 974.115599] env[65136]: INFO networking_nsxv3.common.synchronization [req-e3049c45-ce94-48f8-a329-f82144b770da req-cd49ee72-0885-4463-be6b-ccf4f054e562 service nova] Enqueued Resource ID: 33b8b996-f72b-4039-a3fe-becc7ef14192 with Priority: HIGHEST for action port [ 974.116127] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_rules [ 974.116262] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 974.116362] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33b8b996-f72b-4039-a3fe-becc7ef14192 with Priority: HIGHEST for action port [ 974.117778] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.117919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.117989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.118555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.118640] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.119542] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.120817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.120817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.120817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.120817] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.120817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.120817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.120817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.120817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.120817] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.124451] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-33b8b996-f72b-4039-a3fe-becc7ef14192 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.124451] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33b8b996-f72b-4039-a3fe-becc7ef14192" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.124451] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33b8b996-f72b-4039-a3fe-becc7ef14192" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.124451] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33b8b996-f72b-4039-a3fe-becc7ef14192" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.124451] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33b8b996-f72b-4039-a3fe-becc7ef14192',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.281084] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dec263ea-c810-49ba-b197-517a944e2d17 [ 974.281370] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.281804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.281804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.282549] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.282746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.282901] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dec263ea-c810-49ba-b197-517a944e2d17 already deleted. [ 974.283155] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dec263ea-c810-49ba-b197-517a944e2d17" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.624804] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.625944] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.626121] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.626251] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33b8b996-f72b-4039-a3fe-becc7ef14192 with status ACTIVE [ 974.626408] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.626515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.626576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.626845] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.627035] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.627174] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.627312] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.627360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.627489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.627571] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.627836] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.627925] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.627983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.629568] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.630218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.630323] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33b8b996-f72b-4039-a3fe-becc7ef14192 is going to be updated. [ 974.660726] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.660979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.660979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.661216] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.661382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.661696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33b8b996-f72b-4039-a3fe-becc7ef14192" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.133602] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.638268] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.638268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.638268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.638268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.638873] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.638873] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be created. [ 975.668829] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.668829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.668829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.668829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.668829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.687043] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: UNINITIALIZED for 2s [ 975.917387] env[65136]: INFO networking_nsxv3.common.synchronization [req-1b2b3958-2f9a-4e97-958b-03e6f43f5349 req-36a596f0-0bf9-429c-b906-70c8c61d043d tempest-ListImageFiltersTestJSON-1546457776 tempest-ListImageFiltersTestJSON-1546457776-project-member] Enqueued Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_members [ 975.917826] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_members [ 975.918150] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-40323bed-e172-4548-9cf3-56d3a2a8e71d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.918280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.918348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.918591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.918749] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.918841] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.919750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.919750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.919750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.919750] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.148031] env[65136]: INFO networking_nsxv3.common.synchronization [None req-6d8c25b9-f491-4213-9b22-b66a7e636545 None None] Enqueued Resource ID: acdfac24-1b8b-44cf-8f5a-28fc4c6750b9 with Priority: HIGHEST for action port [ 976.148553] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: acdfac24-1b8b-44cf-8f5a-28fc4c6750b9 with Priority: HIGHEST for action port [ 976.148873] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-acdfac24-1b8b-44cf-8f5a-28fc4c6750b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.148986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-acdfac24-1b8b-44cf-8f5a-28fc4c6750b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.149070] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-acdfac24-1b8b-44cf-8f5a-28fc4c6750b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.149359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-acdfac24-1b8b-44cf-8f5a-28fc4c6750b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.149446] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('acdfac24-1b8b-44cf-8f5a-28fc4c6750b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.389119] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.389119] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.389360] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.389648] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.390048] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.390611] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.390611] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.390700] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.390875] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.391087] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.391476] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.391476] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.391476] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.391600] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.391635] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.391781] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.411471] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.411682] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 976.411811] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.411993] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.412328] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-8fe7864d-d0b4-4b55-acf4-0a4839c75b90 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.413167] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-8fe7864d-d0b4-4b55-acf4-0a4839c75b90" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.413167] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-8fe7864d-d0b4-4b55-acf4-0a4839c75b90" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.413167] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-8fe7864d-d0b4-4b55-acf4-0a4839c75b90" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.413338] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fe7864d-d0b4-4b55-acf4-0a4839c75b90',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.422987] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.423170] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.423219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.423399] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.423497] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.423724] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.423828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.423893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.424075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.424158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.424299] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d already deleted. [ 976.424365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.556820] env[65136]: INFO networking_nsxv3.common.synchronization [None req-f02c1043-103c-44a3-8455-5dd7db9c2924 tempest-ServersTestFqdnHostnames-669601993 tempest-ServersTestFqdnHostnames-669601993-project-member] Enqueued Resource ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 with Priority: HIGHEST for action security_group_rules [ 976.557797] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 with Priority: HIGHEST for action security_group_rules [ 976.557797] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.558013] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.558013] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.558573] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.558573] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4f6034d-9ad4-409e-9b4a-d6ffaa597a63',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.656275] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port acdfac24-1b8b-44cf-8f5a-28fc4c6750b9 [ 976.656275] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.656275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.656275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.656275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.656275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.656275] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:acdfac24-1b8b-44cf-8f5a-28fc4c6750b9 already deleted. [ 976.656275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-acdfac24-1b8b-44cf-8f5a-28fc4c6750b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.916663] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.917014] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.917164] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.917481] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.917640] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.917798] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 8fe7864d-d0b4-4b55-acf4-0a4839c75b90 not found, creating... [ 976.918076] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.918237] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.918357] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.918582] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.918892] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.919012] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.919176] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.919368] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.919680] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.919821] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.919994] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 8fe7864d-d0b4-4b55-acf4-0a4839c75b90 is going to be created. [ 976.941543] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.941737] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.941865] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.942212] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.942979] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.942979] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-8fe7864d-d0b4-4b55-acf4-0a4839c75b90" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.016412] env[65136]: INFO networking_nsxv3.common.synchronization [None req-6e716c33-7ccd-42dc-8318-c00b8a42155a tempest-ServersTestFqdnHostnames-669601993 tempest-ServersTestFqdnHostnames-669601993-project-member] Enqueued Resource ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 with Priority: HIGHEST for action security_group_rules [ 977.016952] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 with Priority: HIGHEST for action security_group_rules [ 977.017392] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.017542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.091077] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.091310] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.091310] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.091521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.091579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.091670] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 already deleted. [ 977.091756] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.092340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.092534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.092974] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4f6034d-9ad4-409e-9b4a-d6ffaa597a63',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.613287] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.613492] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.613492] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.613718] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.613808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.613902] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 already deleted. [ 977.613983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.632986] env[65136]: INFO networking_nsxv3.common.synchronization [req-1b2b3958-2f9a-4e97-958b-03e6f43f5349 req-4bf14a80-9f8a-4482-b03d-cc5a7b702ce9 service nova] Enqueued Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_rules [ 977.633191] env[65136]: INFO networking_nsxv3.common.synchronization [req-1b2b3958-2f9a-4e97-958b-03e6f43f5349 req-4bf14a80-9f8a-4482-b03d-cc5a7b702ce9 service nova] Enqueued Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_members [ 977.633331] env[65136]: INFO networking_nsxv3.common.synchronization [req-1b2b3958-2f9a-4e97-958b-03e6f43f5349 req-4bf14a80-9f8a-4482-b03d-cc5a7b702ce9 service nova] Enqueued Resource ID: 8fe7864d-d0b4-4b55-acf4-0a4839c75b90 with Priority: HIGHEST for action port [ 977.633559] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_rules [ 977.633690] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_members [ 977.633785] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fe7864d-d0b4-4b55-acf4-0a4839c75b90 with Priority: HIGHEST for action port [ 977.634339] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40323bed-e172-4548-9cf3-56d3a2a8e71d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.634698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.634811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.635141] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.635281] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.636147] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-40323bed-e172-4548-9cf3-56d3a2a8e71d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.636469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.636469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.639094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.639094] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.639094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.639094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.639094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.639094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.639094] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.639703] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fe7864d-d0b4-4b55-acf4-0a4839c75b90 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.639703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fe7864d-d0b4-4b55-acf4-0a4839c75b90" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.639703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fe7864d-d0b4-4b55-acf4-0a4839c75b90" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.640092] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fe7864d-d0b4-4b55-acf4-0a4839c75b90" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.643259] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fe7864d-d0b4-4b55-acf4-0a4839c75b90',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.696202] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 977.696524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.697219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.697268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.697454] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.697571] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.697638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.697799] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.697864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.697954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.698150] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.142372] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.143401] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-40323bed-e172-4548-9cf3-56d3a2a8e71d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.143546] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.143861] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8fe7864d-d0b4-4b55-acf4-0a4839c75b90 with status ACTIVE [ 978.144042] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.144150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.144216] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.144416] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.144502] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.145876] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.145876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.145876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.145876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.146662] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.146872] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.146983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.147069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.147268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.148666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.148666] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8fe7864d-d0b4-4b55-acf4-0a4839c75b90 is going to be updated. [ 978.172259] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.172345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.172582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.172825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.172999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.173214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fe7864d-d0b4-4b55-acf4-0a4839c75b90" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.201267] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.202023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.202023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.202023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.202023] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.202023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.202023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.202224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.202224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.202224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.203613] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.203613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.203613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.203613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.203613] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.203613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.203613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.203613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.203613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.203613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.203613] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.551117] env[65136]: INFO networking_nsxv3.common.synchronization [req-ca8e450f-c912-449a-98d9-b495449c6830 req-5fbd4769-057a-496c-a9c3-5b1022ce69fa tempest-ListImageFiltersTestJSON-1546457776 tempest-ListImageFiltersTestJSON-1546457776-project-member] Enqueued Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_members [ 978.551641] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_members [ 978.551947] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-40323bed-e172-4548-9cf3-56d3a2a8e71d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.552072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.647973] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.706024] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ffd4802-244f-43db-9a7c-a5a1b6672fde: rpc.has_security_group_logging(os_id): False [ 978.725645] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.725645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.725645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.725847] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.725929] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.726152] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.726245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.726310] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.726459] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.726553] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.726707] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.726800] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.726860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.726995] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.727081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.727258] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.727375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.727405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.727555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.727631] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.727744] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be created. [ 978.787138] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.787692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.787852] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.788133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.788437] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.808018] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: IN_PROGRESS for 2s [ 978.842315] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-460 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.842556] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.842666] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.842953] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.843351] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.843698] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.843698] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.844236] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.844236] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.844516] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.844625] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.844706] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.844860] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.845133] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.845191] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.845630] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.876489] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.879375] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 978.879375] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.879375] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-460" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.879375] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.879375] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.879375] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.879375] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.879375] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.148888] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.149129] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.149129] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.149410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.149510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.149610] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d is going to be created. [ 979.175797] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.176045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.176045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.176240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.176399] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.186475] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d in Status: UNINITIALIZED for 2s [ 979.381199] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.381588] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.381766] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.382202] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.382436] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.382674] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5 not found, creating... [ 979.383067] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.383288] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.383462] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.383778] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.384028] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.384404] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.384643] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.384827] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.385121] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.385300] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.385486] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5 is going to be created. [ 979.420100] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.420100] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.420553] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.420553] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.420661] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.420930] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.123704] env[65136]: INFO networking_nsxv3.common.synchronization [req-ca8e450f-c912-449a-98d9-b495449c6830 req-4aa1e1da-79ab-41dc-be19-db39e2ba05ea service nova] Enqueued Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_rules [ 980.123704] env[65136]: INFO networking_nsxv3.common.synchronization [req-ca8e450f-c912-449a-98d9-b495449c6830 req-4aa1e1da-79ab-41dc-be19-db39e2ba05ea service nova] Enqueued Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_members [ 980.124192] env[65136]: INFO networking_nsxv3.common.synchronization [req-ca8e450f-c912-449a-98d9-b495449c6830 req-4aa1e1da-79ab-41dc-be19-db39e2ba05ea service nova] Enqueued Resource ID: 8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5 with Priority: HIGHEST for action port [ 980.124676] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_rules [ 980.124676] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_members [ 980.124676] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5 with Priority: HIGHEST for action port [ 980.124883] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40323bed-e172-4548-9cf3-56d3a2a8e71d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.124932] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.125681] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-40323bed-e172-4548-9cf3-56d3a2a8e71d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.125681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.125877] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.126000] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.126093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.126313] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.126415] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.630760] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5 with status ACTIVE [ 980.631116] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.631366] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.631464] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.631883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.632058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.632312] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.632496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.632632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.632873] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.633043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.633300] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.634113] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.634113] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.634113] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.634113] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.634113] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5 is going to be updated. [ 980.671374] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.671634] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.671634] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.672107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.672107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.672254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b88ceba-efb3-4e80-9c6e-7cb8eb23cee5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.820679] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 980.820923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.197075] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d in Status: SUCCESS [ 981.197444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.197444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.197671] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.197867] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.197984] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.198062] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.198987] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.198987] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.198987] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.198987] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.199392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.199561] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.199717] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.199817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.201181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.201322] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.201467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.201597] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.463166] env[65136]: INFO networking_nsxv3.common.synchronization [req-57f9851e-68a9-4a31-9805-f05e73557a55 req-373e8565-1f9f-4733-acfe-f89b1fcaca61 tempest-ServerDiskConfigTestJSON-1818502390 tempest-ServerDiskConfigTestJSON-1818502390-project-member] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 981.463692] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 981.464009] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.464143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.464363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.464437] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.464560] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.464651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.464714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.464862] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.464940] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.465197] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.705745] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-40323bed-e172-4548-9cf3-56d3a2a8e71d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.705745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.705745] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.968675] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.968841] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.968926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.969180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.991266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.991419] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.991677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.991677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.992350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.992350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.992350] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be updated. [ 982.022178] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.022365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.022798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.022798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.022798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.033876] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 982.208957] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.281630] env[65136]: INFO networking_nsxv3.common.synchronization [None req-ff3aac77-10df-4387-bd56-7d304c1632ca tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 982.282398] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 982.282774] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.282910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.283010] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.284428] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.285128] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.285128] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.285128] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.285351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.285351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.285552] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.711606] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.711863] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.711863] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.712218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.712368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.712505] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d is going to be updated. [ 982.767188] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.767448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.767448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.767626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.767763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.780286] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d in Status: IN_PROGRESS for 2s [ 982.790733] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.299233] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.802824] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.802824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.802824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.802824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.803101] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.803101] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be updated. [ 983.833736] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.834067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.834067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.834329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.834532] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.845502] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: IN_PROGRESS for 2s [ 984.044734] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 984.045020] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d deletion is rescheduled due to dependency. [ 984.045065] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.431232] env[65136]: INFO networking_nsxv3.common.synchronization [None req-1d2e6f40-ff49-4aad-8172-e42472407776 None None] Enqueued Resource ID: 68f4cac8-fcb7-48f8-8e72-68d429e3d608 with Priority: HIGHEST for action port [ 984.431499] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68f4cac8-fcb7-48f8-8e72-68d429e3d608 with Priority: HIGHEST for action port [ 984.431746] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-68f4cac8-fcb7-48f8-8e72-68d429e3d608 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.431876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68f4cac8-fcb7-48f8-8e72-68d429e3d608" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.431944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68f4cac8-fcb7-48f8-8e72-68d429e3d608" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.432233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68f4cac8-fcb7-48f8-8e72-68d429e3d608" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.432320] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68f4cac8-fcb7-48f8-8e72-68d429e3d608',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.796189] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d in Status: SUCCESS [ 984.796189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.796189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.796189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.796189] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.796189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.796189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.796189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.796189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.796189] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.934927] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68f4cac8-fcb7-48f8-8e72-68d429e3d608 [ 984.935366] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.935560] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.935645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.935917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.936097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.937700] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68f4cac8-fcb7-48f8-8e72-68d429e3d608 already deleted. [ 984.937700] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68f4cac8-fcb7-48f8-8e72-68d429e3d608" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.999786] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-998 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.999986] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.999986] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.000332] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.000684] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.000904] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.001058] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.001319] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.001493] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.001768] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.001912] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.002054] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.002207] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.002353] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.002734] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.002734] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.024879] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.025145] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 985.025438] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.025641] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.026033] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-b32b6cd3-98a5-4da5-836e-fbe490a3379d taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.026244] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-b32b6cd3-98a5-4da5-836e-fbe490a3379d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.026347] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-b32b6cd3-98a5-4da5-836e-fbe490a3379d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.026674] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-b32b6cd3-98a5-4da5-836e-fbe490a3379d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.026842] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b32b6cd3-98a5-4da5-836e-fbe490a3379d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.301780] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.531258] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.531555] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.531648] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.531954] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.532127] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.532295] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port b32b6cd3-98a5-4da5-836e-fbe490a3379d not found, creating... [ 985.532605] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.532821] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.532945] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.533187] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.533323] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.533658] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.533820] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.533939] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.534194] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.534332] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.534496] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: b32b6cd3-98a5-4da5-836e-fbe490a3379d is going to be created. [ 985.566187] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.566187] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.566187] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.567124] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.567124] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.567124] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-b32b6cd3-98a5-4da5-836e-fbe490a3379d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.803753] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.858543] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 985.858543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.308200] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.308383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.308547] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.308657] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.308749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.308852] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d is going to be updated. [ 986.312509] env[65136]: INFO networking_nsxv3.common.synchronization [req-a1f7a937-36a1-4a89-976b-02a4ddcbfccb req-5ad24335-2c5f-4e32-ac9c-a10e7a2609cb service nova] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_rules [ 986.312853] env[65136]: INFO networking_nsxv3.common.synchronization [req-a1f7a937-36a1-4a89-976b-02a4ddcbfccb req-5ad24335-2c5f-4e32-ac9c-a10e7a2609cb service nova] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 986.313060] env[65136]: INFO networking_nsxv3.common.synchronization [req-a1f7a937-36a1-4a89-976b-02a4ddcbfccb req-5ad24335-2c5f-4e32-ac9c-a10e7a2609cb service nova] Enqueued Resource ID: b32b6cd3-98a5-4da5-836e-fbe490a3379d with Priority: HIGHEST for action port [ 986.314170] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_rules [ 986.314278] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 986.314358] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b32b6cd3-98a5-4da5-836e-fbe490a3379d with Priority: HIGHEST for action port [ 986.314634] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.314843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.314843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.315105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.315207] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.316994] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.317184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.317274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.317438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.318110] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.318110] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.318110] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.318110] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.318280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.318309] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.319442] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-b32b6cd3-98a5-4da5-836e-fbe490a3379d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.319442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b32b6cd3-98a5-4da5-836e-fbe490a3379d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.319442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b32b6cd3-98a5-4da5-836e-fbe490a3379d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.319648] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b32b6cd3-98a5-4da5-836e-fbe490a3379d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.319648] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b32b6cd3-98a5-4da5-836e-fbe490a3379d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.344817] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.344817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.344817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.344817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.344817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.355979] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d in Status: IN_PROGRESS for 2s [ 986.675043] env[65136]: INFO networking_nsxv3.common.synchronization [None req-d7a6292a-c62c-4374-951d-45cf39dceccc None None] Enqueued Resource ID: ebb7d971-8044-4447-b681-d864444f1103 with Priority: HIGHEST for action port [ 986.675658] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebb7d971-8044-4447-b681-d864444f1103 with Priority: HIGHEST for action port [ 986.676596] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebb7d971-8044-4447-b681-d864444f1103 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.676596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebb7d971-8044-4447-b681-d864444f1103" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.676596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebb7d971-8044-4447-b681-d864444f1103" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.676596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebb7d971-8044-4447-b681-d864444f1103" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.676596] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebb7d971-8044-4447-b681-d864444f1103',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.821197] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.821332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.824584] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b32b6cd3-98a5-4da5-836e-fbe490a3379d with status ACTIVE [ 986.825225] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.825430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.825530] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.825801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.826038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.826172] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.826306] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.826420] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.826583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.826683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.828205] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.828205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.828205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.828205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.828205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.828205] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b32b6cd3-98a5-4da5-836e-fbe490a3379d is going to be updated. [ 986.829012] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.850219] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.850591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.850591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.850785] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.850837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.850960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b32b6cd3-98a5-4da5-836e-fbe490a3379d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.940120] env[65136]: INFO networking_nsxv3.common.synchronization [req-273251bd-7c3d-4139-bd41-b0d0b5755899 req-d1bd6047-bea6-47be-8254-45122658bbfd tempest-AttachVolumeTestJSON-333791645 tempest-AttachVolumeTestJSON-333791645-project-member] Enqueued Resource ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c with Priority: HIGHEST for action security_group_members [ 986.940120] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c with Priority: HIGHEST for action security_group_members [ 986.940802] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.942552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.942552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.942552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.942552] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.942552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.942552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.942552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.942552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.942552] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9a81b8-cfea-4cf0-a7c1-6c152505127c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.179221] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebb7d971-8044-4447-b681-d864444f1103 [ 987.179636] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.179837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.179963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.180255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.180403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.180551] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebb7d971-8044-4447-b681-d864444f1103 already deleted. [ 987.180695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebb7d971-8044-4447-b681-d864444f1103" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.305846] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.306109] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-121" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.306182] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-121" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.306648] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-121" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.306932] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.307102] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.307249] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.307544] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.307807] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.307963] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 987.308042] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 987.308187] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 987.308237] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 987.308356] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 987.308420] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 987.308589] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 987.331833] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.335972] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 987.336753] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 987.336753] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 987.336753] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-121" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.336925] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-1c96a162-a28f-4689-a6ec-0ca255a0c9e5 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.337045] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-1c96a162-a28f-4689-a6ec-0ca255a0c9e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.337148] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-1c96a162-a28f-4689-a6ec-0ca255a0c9e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.338176] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-1c96a162-a28f-4689-a6ec-0ca255a0c9e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.338176] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c96a162-a28f-4689-a6ec-0ca255a0c9e5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.445181] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.445428] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.445636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.445709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.445772] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.445955] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.446133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.446133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.446291] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.446363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.446533] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c already deleted. [ 987.446533] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.595395] env[65136]: INFO networking_nsxv3.common.synchronization [req-82d77408-cbd9-420c-b423-6000c5aa5017 req-0db7267d-cef0-46a8-bdeb-e7f7d6ef5439 tempest-SecurityGroupRulesTestJSON-1548779201 tempest-SecurityGroupRulesTestJSON-1548779201-project-member] Enqueued Resource ID: 55ba69cd-d394-4cb2-a093-3bbf8433a537 with Priority: HIGHEST for action security_group_rules [ 987.597232] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55ba69cd-d394-4cb2-a093-3bbf8433a537 with Priority: HIGHEST for action security_group_rules [ 987.597232] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55ba69cd-d394-4cb2-a093-3bbf8433a537 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.597232] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55ba69cd-d394-4cb2-a093-3bbf8433a537" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.597232] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55ba69cd-d394-4cb2-a093-3bbf8433a537" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.597232] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55ba69cd-d394-4cb2-a093-3bbf8433a537" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.597593] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55ba69cd-d394-4cb2-a093-3bbf8433a537',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.836485] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.836485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.836485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.836485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.836485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.836485] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be updated. [ 987.841399] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.841609] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.841609] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.841867] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.842034] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.842213] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 1c96a162-a28f-4689-a6ec-0ca255a0c9e5 not found, creating... [ 987.842492] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.842649] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.842764] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.842999] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.843174] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.843465] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.843648] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.843769] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.844040] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.844223] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.844392] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 1c96a162-a28f-4689-a6ec-0ca255a0c9e5 is going to be created. [ 987.865643] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.865908] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.865976] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.866259] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.866492] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.866824] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-1c96a162-a28f-4689-a6ec-0ca255a0c9e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.869615] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.869615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.869615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.869863] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.870069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.881877] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: IN_PROGRESS for 2s [ 988.120273] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.120432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.120514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.120728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.120816] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.120915] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55ba69cd-d394-4cb2-a093-3bbf8433a537 already deleted. [ 988.120994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55ba69cd-d394-4cb2-a093-3bbf8433a537" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.367215] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d in Status: SUCCESS [ 988.367660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.367846] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.368107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.368319] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.368416] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.368507] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.368679] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.368753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.368886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.369130] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-40323bed-e172-4548-9cf3-56d3a2a8e71d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.370071] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.370263] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.370401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.370581] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.370693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.370767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.370912] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.370994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.371097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.371196] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.609480] env[65136]: INFO networking_nsxv3.common.synchronization [req-273251bd-7c3d-4139-bd41-b0d0b5755899 req-958039a8-3696-424b-b71b-a09a9eb3c38b service nova] Enqueued Resource ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c with Priority: HIGHEST for action security_group_rules [ 988.609737] env[65136]: INFO networking_nsxv3.common.synchronization [req-273251bd-7c3d-4139-bd41-b0d0b5755899 req-958039a8-3696-424b-b71b-a09a9eb3c38b service nova] Enqueued Resource ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c with Priority: HIGHEST for action security_group_members [ 988.609930] env[65136]: INFO networking_nsxv3.common.synchronization [req-273251bd-7c3d-4139-bd41-b0d0b5755899 req-958039a8-3696-424b-b71b-a09a9eb3c38b service nova] Enqueued Resource ID: 1c96a162-a28f-4689-a6ec-0ca255a0c9e5 with Priority: HIGHEST for action port [ 988.610524] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c with Priority: HIGHEST for action security_group_rules [ 988.610688] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c with Priority: HIGHEST for action security_group_members [ 988.610795] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c96a162-a28f-4689-a6ec-0ca255a0c9e5 with Priority: HIGHEST for action port [ 988.611266] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a9a81b8-cfea-4cf0-a7c1-6c152505127c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.611440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.611570] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.611718] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.611799] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a9a81b8-cfea-4cf0-a7c1-6c152505127c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.613343] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.613477] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.613556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.613794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.613937] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.614012] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.614074] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.614212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.614356] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.614400] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9a81b8-cfea-4cf0-a7c1-6c152505127c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.615932] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c96a162-a28f-4689-a6ec-0ca255a0c9e5 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.616158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c96a162-a28f-4689-a6ec-0ca255a0c9e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.616330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c96a162-a28f-4689-a6ec-0ca255a0c9e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.616412] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c96a162-a28f-4689-a6ec-0ca255a0c9e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.616534] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c96a162-a28f-4689-a6ec-0ca255a0c9e5',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.725414] env[65136]: INFO networking_nsxv3.common.synchronization [req-d691e13a-c62f-4e7b-b494-6b43fba9fd3f req-c88e3f66-ae1e-47ae-ab22-5a57076ce965 tempest-SecurityGroupRulesTestJSON-1548779201 tempest-SecurityGroupRulesTestJSON-1548779201-project-member] Enqueued Resource ID: 63965435-b067-4077-96de-8044c38469c8 with Priority: HIGHEST for action security_group_rules [ 988.725414] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63965435-b067-4077-96de-8044c38469c8 with Priority: HIGHEST for action security_group_rules [ 988.725414] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63965435-b067-4077-96de-8044c38469c8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.725414] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63965435-b067-4077-96de-8044c38469c8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.725414] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63965435-b067-4077-96de-8044c38469c8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.725652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63965435-b067-4077-96de-8044c38469c8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.725822] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63965435-b067-4077-96de-8044c38469c8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.824129] env[65136]: INFO networking_nsxv3.common.synchronization [req-1a07ecbc-be9f-4475-8614-8add4ab45ebe req-ea6a93b2-eb59-46f4-9578-1bf6dc010de2 tempest-ImagesTestJSON-1051903205 tempest-ImagesTestJSON-1051903205-project-member] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 988.824647] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 988.824955] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.825097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.825165] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.825369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.825518] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.825614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.825707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.825817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.825906] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.826333] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.874987] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40323bed-e172-4548-9cf3-56d3a2a8e71d: rpc.has_security_group_logging(os_id): False [ 988.894306] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.894452] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.894524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.894742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.894835] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.895080] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.895258] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.895353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.895553] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.895637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.895847] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.895947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.896021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.896168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.896245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.896428] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.896517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.896584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.896723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.896799] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.896885] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d is going to be created. [ 988.964532] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.964755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.964755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.964945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.965146] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.976277] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d in Status: IN_PROGRESS for 2s [ 989.113858] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.114047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.116326] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a9a81b8-cfea-4cf0-a7c1-6c152505127c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.120612] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c96a162-a28f-4689-a6ec-0ca255a0c9e5 with status ACTIVE [ 989.120887] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.121584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.121584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.121584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.121584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.121774] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.121825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.121874] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.122060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.122139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.122320] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.122407] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.122465] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.122670] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.122670] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.122769] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c96a162-a28f-4689-a6ec-0ca255a0c9e5 is going to be updated. [ 989.161591] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.161799] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.161955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.162175] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.162317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.162459] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c96a162-a28f-4689-a6ec-0ca255a0c9e5" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.247208] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.247375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.247447] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.247665] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.247752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.247844] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63965435-b067-4077-96de-8044c38469c8 already deleted. [ 989.247927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63965435-b067-4077-96de-8044c38469c8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.328019] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.618576] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a9a81b8-cfea-4cf0-a7c1-6c152505127c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.831875] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.892427] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 989.892697] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.892891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.893158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.893357] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.893478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.893566] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.894221] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.894221] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.894221] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.894221] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.121895] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.122197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.122197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.122477] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.122640] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.122720] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c is going to be created. [ 990.149046] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.149046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.149046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.149917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.149917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.163026] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c in Status: UNINITIALIZED for 2s [ 990.334338] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.334531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.334531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.334751] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.335440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.335440] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 990.366782] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.366782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.366782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.366964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.367047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.379843] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 990.396688] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.396857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.396931] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.397273] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.397603] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.397762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.397836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.398064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.398214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.398343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.398559] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.398665] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.398771] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.398930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.399089] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.399189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.399283] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.399415] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.399495] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.399578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.399670] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.409024] env[65136]: INFO networking_nsxv3.common.synchronization [req-b5b4c225-62bf-4133-aed8-1c242ccedf42 req-9d2e56a7-31c3-4fb7-9c7d-491935953ebc tempest-AttachVolumeShelveTestJSON-1302323664 tempest-AttachVolumeShelveTestJSON-1302323664-project-member] Enqueued Resource ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c with Priority: HIGHEST for action security_group_members [ 990.409577] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c with Priority: HIGHEST for action security_group_members [ 990.409941] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.410391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.410513] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.410865] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.411689] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.411847] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.412627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.412867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.413132] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.413677] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.704849] env[65136]: INFO networking_nsxv3.common.synchronization [req-19f01d2f-5cac-4bd6-9745-59d0c249ed15 req-15ac4527-4c75-44b9-bd7e-72dca981669a tempest-SecurityGroupRulesTestJSON-1548779201 tempest-SecurityGroupRulesTestJSON-1548779201-project-member] Enqueued Resource ID: e50a9a58-253f-45b0-ae28-a9a8d36d9c66 with Priority: HIGHEST for action security_group_rules [ 990.705622] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50a9a58-253f-45b0-ae28-a9a8d36d9c66 with Priority: HIGHEST for action security_group_rules [ 990.707313] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e50a9a58-253f-45b0-ae28-a9a8d36d9c66 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.707517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e50a9a58-253f-45b0-ae28-a9a8d36d9c66" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.707585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e50a9a58-253f-45b0-ae28-a9a8d36d9c66" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.707872] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e50a9a58-253f-45b0-ae28-a9a8d36d9c66" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.709204] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e50a9a58-253f-45b0-ae28-a9a8d36d9c66',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.810600] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-330 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.810847] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-330" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.810967] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-330" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.811321] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-330" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.811641] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.811788] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.811938] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.812132] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.812585] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.812585] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.812718] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.812760] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.812843] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.812957] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.813130] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.813334] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.835025] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.835354] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 990.835618] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.837044] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-330" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.837044] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-6df71ef4-3d27-458f-9ad7-4485f0a6da19 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.837044] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-6df71ef4-3d27-458f-9ad7-4485f0a6da19" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.837044] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-6df71ef4-3d27-458f-9ad7-4485f0a6da19" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.837470] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-6df71ef4-3d27-458f-9ad7-4485f0a6da19" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.837724] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df71ef4-3d27-458f-9ad7-4485f0a6da19',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.903299] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ffd4802-244f-43db-9a7c-a5a1b6672fde: rpc.has_security_group_logging(os_id): False [ 990.917784] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.917784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.917904] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.918064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.918160] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.918368] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.918585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.918585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.918689] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.918727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.918810] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c already deleted. [ 990.918889] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.924991] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.925246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.925323] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.925522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.925636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.925876] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.925978] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.926049] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.926213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.926292] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.926466] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.926621] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.926721] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.926915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.927045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.927334] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.927488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.927568] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.927717] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.927796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.927948] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be updated. [ 990.997894] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d in Status: SUCCESS [ 990.997894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.997894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.998531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.998687] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.017973] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.018186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.018186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.018409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.018558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.036475] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: IN_PROGRESS for 2s [ 991.231373] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.231607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.231607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.231789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.231879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.231970] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e50a9a58-253f-45b0-ae28-a9a8d36d9c66 already deleted. [ 991.232063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e50a9a58-253f-45b0-ae28-a9a8d36d9c66" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.341246] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.342340] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.342340] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.343025] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.343270] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.343485] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 6df71ef4-3d27-458f-9ad7-4485f0a6da19 not found, creating... [ 991.344056] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.344334] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.344522] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.344819] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.345084] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.345457] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.345747] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.345989] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.347525] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.347525] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.347525] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 6df71ef4-3d27-458f-9ad7-4485f0a6da19 is going to be created. [ 991.370055] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.370055] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.370365] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.370685] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.370927] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.371175] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-6df71ef4-3d27-458f-9ad7-4485f0a6da19" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.502484] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-40323bed-e172-4548-9cf3-56d3a2a8e71d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.504993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.504993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.504993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.504993] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.504993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.504993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.504993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.504993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.504993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.504993] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.619487] env[65136]: INFO networking_nsxv3.common.synchronization [req-7ab3dca2-15e7-4f63-b6a1-d4ec2f5102fd req-660a7614-6422-4e7c-b0c5-083c2f5c20a0 tempest-ServersNegativeTestJSON-605919058 tempest-ServersNegativeTestJSON-605919058-project-member] Enqueued Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_members [ 991.620308] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGHEST for action security_group_members [ 991.620742] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.624036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.624036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.624036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.624036] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.624036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.624036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.624036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.624036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.624036] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.008436] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-40323bed-e172-4548-9cf3-56d3a2a8e71d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.008850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.008850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.008925] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.009058] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.009154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.009218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.009825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.009825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.009825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.009825] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-40323bed-e172-4548-9cf3-56d3a2a8e71d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.009825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.010147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.010147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.010147] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.010246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.010279] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.010612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.010612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.010612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.010765] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.060192] env[65136]: INFO networking_nsxv3.common.synchronization [req-b5b4c225-62bf-4133-aed8-1c242ccedf42 req-72d37866-60d0-4d0a-8f4d-260ad824b861 service nova] Enqueued Resource ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c with Priority: HIGHEST for action security_group_rules [ 992.060192] env[65136]: INFO networking_nsxv3.common.synchronization [req-b5b4c225-62bf-4133-aed8-1c242ccedf42 req-72d37866-60d0-4d0a-8f4d-260ad824b861 service nova] Enqueued Resource ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c with Priority: HIGHEST for action security_group_members [ 992.060192] env[65136]: INFO networking_nsxv3.common.synchronization [req-b5b4c225-62bf-4133-aed8-1c242ccedf42 req-72d37866-60d0-4d0a-8f4d-260ad824b861 service nova] Enqueued Resource ID: 6df71ef4-3d27-458f-9ad7-4485f0a6da19 with Priority: HIGHEST for action port [ 992.060192] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c with Priority: HIGHEST for action security_group_rules [ 992.060192] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c with Priority: HIGHEST for action security_group_members [ 992.060192] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6df71ef4-3d27-458f-9ad7-4485f0a6da19 with Priority: HIGHEST for action port [ 992.060192] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.061170] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.061170] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.061434] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.061434] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.062337] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.063038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.063038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.063038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.063038] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.063038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.063038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.063392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.063392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.063392] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.064123] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-6df71ef4-3d27-458f-9ad7-4485f0a6da19 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.064251] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6df71ef4-3d27-458f-9ad7-4485f0a6da19" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.064319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6df71ef4-3d27-458f-9ad7-4485f0a6da19" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.064469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6df71ef4-3d27-458f-9ad7-4485f0a6da19" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.064558] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6df71ef4-3d27-458f-9ad7-4485f0a6da19',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.127458] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.127620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.127693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.128025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.128178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.128398] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.128504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.128568] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.128732] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.128810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.128896] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b is going to be updated. [ 992.155888] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.156052] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.156108] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.156302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.156500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.168185] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: IN_PROGRESS for 2s [ 992.171284] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c in Status: SUCCESS [ 992.171494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.171649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.171858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.172059] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.172637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.172637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.172637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.172637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.172637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.172637] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a9a81b8-cfea-4cf0-a7c1-6c152505127c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.399885] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 992.400120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.513992] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 40323bed-e172-4548-9cf3-56d3a2a8e71d: rpc.has_security_group_logging(os_id): False [ 992.536809] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.536809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.536809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.536809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.536809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.537839] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.537839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.537839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.537839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.537839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.537839] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.537839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.537839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.538341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.538341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.538341] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.538602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.538602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.539098] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.539098] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.539098] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d is going to be updated. [ 992.569033] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.572381] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.572381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.572381] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6df71ef4-3d27-458f-9ad7-4485f0a6da19 with status ACTIVE [ 992.572381] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.572381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.572381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.572381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.572381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.572381] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.572381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.572381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.572381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.572381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.572381] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.573257] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.573257] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.573257] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.573257] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.573257] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6df71ef4-3d27-458f-9ad7-4485f0a6da19 is going to be updated. [ 992.585340] env[65136]: INFO networking_nsxv3.common.synchronization [req-527f46d0-8967-4f49-98a1-fa39e35b1f86 req-fbb06b62-796f-47d5-8a23-dd23c6097f5d tempest-SecurityGroupRulesTestJSON-1548779201 tempest-SecurityGroupRulesTestJSON-1548779201-project-member] Enqueued Resource ID: fbcaa843-9cfe-47f1-a0f2-e09dcc3a5db4 with Priority: HIGHEST for action security_group_rules [ 992.585543] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbcaa843-9cfe-47f1-a0f2-e09dcc3a5db4 with Priority: HIGHEST for action security_group_rules [ 992.586218] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbcaa843-9cfe-47f1-a0f2-e09dcc3a5db4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.586499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbcaa843-9cfe-47f1-a0f2-e09dcc3a5db4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.586693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbcaa843-9cfe-47f1-a0f2-e09dcc3a5db4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.587061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbcaa843-9cfe-47f1-a0f2-e09dcc3a5db4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.587252] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbcaa843-9cfe-47f1-a0f2-e09dcc3a5db4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.607115] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.607115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.607115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.607115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.607115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.607115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6df71ef4-3d27-458f-9ad7-4485f0a6da19" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.620551] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.620727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.620809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.621063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.621229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.639182] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d in Status: IN_PROGRESS for 2s [ 992.674966] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a9a81b8-cfea-4cf0-a7c1-6c152505127c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.931032] env[65136]: INFO networking_nsxv3.common.synchronization [req-9d9fa9bc-7d29-4098-8233-c0b98c39954f req-30caa50d-2693-4a1d-95c3-274f14d8c3a8 tempest-ServersTestFqdnHostnames-669601993 tempest-ServersTestFqdnHostnames-669601993-project-member] Enqueued Resource ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 with Priority: HIGHEST for action security_group_members [ 992.931032] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 with Priority: HIGHEST for action security_group_members [ 992.931032] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.931032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.931032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.931032] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.933111] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.933111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.933111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.933111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.933111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.933111] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4f6034d-9ad4-409e-9b4a-d6ffaa597a63',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.051253] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 993.051712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.076157] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.112322] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.112536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.112536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.112944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.112944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.112944] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbcaa843-9cfe-47f1-a0f2-e09dcc3a5db4 already deleted. [ 993.113082] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbcaa843-9cfe-47f1-a0f2-e09dcc3a5db4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.179941] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a9a81b8-cfea-4cf0-a7c1-6c152505127c: rpc.has_security_group_logging(os_id): False [ 993.210778] env[65136]: INFO networking_nsxv3.common.synchronization [req-89f3a6e4-b1af-4ba2-a202-e8c4f500e6a3 req-03505b18-10ca-441b-9baf-62f1628690f7 tempest-SecurityGroupRulesTestJSON-1548779201 tempest-SecurityGroupRulesTestJSON-1548779201-project-member] Enqueued Resource ID: ea332971-c82a-4d07-a6bf-7fd2100dfbbb with Priority: HIGHEST for action security_group_rules [ 993.210778] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea332971-c82a-4d07-a6bf-7fd2100dfbbb with Priority: HIGHEST for action security_group_rules [ 993.210778] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea332971-c82a-4d07-a6bf-7fd2100dfbbb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.211375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea332971-c82a-4d07-a6bf-7fd2100dfbbb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.211375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea332971-c82a-4d07-a6bf-7fd2100dfbbb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.211375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea332971-c82a-4d07-a6bf-7fd2100dfbbb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.211474] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea332971-c82a-4d07-a6bf-7fd2100dfbbb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.223412] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.224015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.224015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.224015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.224015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.224220] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.224283] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.224385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.224477] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.224552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.224641] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c is going to be created. [ 993.295793] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-89 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.296456] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-89" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.296968] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-89" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.297226] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-89" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.297712] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.298182] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.298287] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.298807] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.299027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.299465] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.299606] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 993.299899] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 993.300019] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 993.300323] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 993.300441] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 993.300718] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 993.327028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.327227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.327409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.327636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.327890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.330549] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 993.330714] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 993.330873] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 993.331161] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-89" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.331423] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-08058de8-daae-4c07-8b28-4a6e6b17338a taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.331606] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-08058de8-daae-4c07-8b28-4a6e6b17338a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.331869] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-08058de8-daae-4c07-8b28-4a6e6b17338a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.332195] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-08058de8-daae-4c07-8b28-4a6e6b17338a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.332410] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08058de8-daae-4c07-8b28-4a6e6b17338a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.351136] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c in Status: IN_PROGRESS for 2s [ 993.435716] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.435852] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.435956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.436235] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.436336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.436662] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.436740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.436774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.436943] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.437116] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.437263] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 already deleted. [ 993.437351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.580205] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.580205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.580424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.580519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.580618] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.580723] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c is going to be created. [ 993.610886] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.611119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.611119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.611359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.611564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.631198] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c in Status: UNINITIALIZED for 2s [ 993.740472] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.740737] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.740737] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.740896] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.741061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.741152] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea332971-c82a-4d07-a6bf-7fd2100dfbbb already deleted. [ 993.741234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea332971-c82a-4d07-a6bf-7fd2100dfbbb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.762830] env[65136]: INFO networking_nsxv3.common.synchronization [req-bb730900-840a-48c0-9092-6c523bbafb0c req-f882f2a1-fb2d-4c87-955f-e659e0285bd3 tempest-SecurityGroupRulesTestJSON-1548779201 tempest-SecurityGroupRulesTestJSON-1548779201-project-member] Enqueued Resource ID: ea332971-c82a-4d07-a6bf-7fd2100dfbbb with Priority: HIGHEST for action security_group_rules [ 993.763434] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea332971-c82a-4d07-a6bf-7fd2100dfbbb with Priority: HIGHEST for action security_group_rules [ 993.763764] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea332971-c82a-4d07-a6bf-7fd2100dfbbb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.763883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea332971-c82a-4d07-a6bf-7fd2100dfbbb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.763943] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea332971-c82a-4d07-a6bf-7fd2100dfbbb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.764173] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea332971-c82a-4d07-a6bf-7fd2100dfbbb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.764301] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea332971-c82a-4d07-a6bf-7fd2100dfbbb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.836701] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.837052] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.837329] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.837740] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.838009] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.838180] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 08058de8-daae-4c07-8b28-4a6e6b17338a not found, creating... [ 993.838622] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.838796] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.838963] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.839609] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.840260] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.840787] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.841975] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.842109] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.842397] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.842595] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.842800] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 08058de8-daae-4c07-8b28-4a6e6b17338a is going to be created. [ 993.866321] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.866529] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.866662] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.867904] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.868176] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.868418] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-08058de8-daae-4c07-8b28-4a6e6b17338a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.177816] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b in Status: SUCCESS [ 994.178170] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b deletion is rescheduled due to dependency. [ 994.178170] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.198554] env[65136]: INFO networking_nsxv3.common.synchronization [req-5324e714-a657-4a29-889b-cc1e3fa451aa req-479a9542-eb5a-438e-a052-5bffad69cabb tempest-SecurityGroupRulesTestJSON-1548779201 tempest-SecurityGroupRulesTestJSON-1548779201-project-member] Enqueued Resource ID: ea332971-c82a-4d07-a6bf-7fd2100dfbbb with Priority: HIGHEST for action security_group_rules [ 994.199065] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea332971-c82a-4d07-a6bf-7fd2100dfbbb with Priority: HIGHEST for action security_group_rules [ 994.199408] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea332971-c82a-4d07-a6bf-7fd2100dfbbb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.199509] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea332971-c82a-4d07-a6bf-7fd2100dfbbb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.291083] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.291297] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.291382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.291632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.291726] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.291823] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea332971-c82a-4d07-a6bf-7fd2100dfbbb already deleted. [ 994.291900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea332971-c82a-4d07-a6bf-7fd2100dfbbb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.292079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea332971-c82a-4d07-a6bf-7fd2100dfbbb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.292358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea332971-c82a-4d07-a6bf-7fd2100dfbbb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.292447] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea332971-c82a-4d07-a6bf-7fd2100dfbbb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.625863] env[65136]: INFO networking_nsxv3.common.synchronization [req-9d9fa9bc-7d29-4098-8233-c0b98c39954f req-48cd20a7-b767-4bbb-b304-87e2c9dea544 service nova] Enqueued Resource ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 with Priority: HIGHEST for action security_group_rules [ 994.626179] env[65136]: INFO networking_nsxv3.common.synchronization [req-9d9fa9bc-7d29-4098-8233-c0b98c39954f req-48cd20a7-b767-4bbb-b304-87e2c9dea544 service nova] Enqueued Resource ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 with Priority: HIGHEST for action security_group_members [ 994.626429] env[65136]: INFO networking_nsxv3.common.synchronization [req-9d9fa9bc-7d29-4098-8233-c0b98c39954f req-48cd20a7-b767-4bbb-b304-87e2c9dea544 service nova] Enqueued Resource ID: 08058de8-daae-4c07-8b28-4a6e6b17338a with Priority: HIGHEST for action port [ 994.627629] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 with Priority: HIGHEST for action security_group_rules [ 994.627879] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 with Priority: HIGHEST for action security_group_members [ 994.628133] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08058de8-daae-4c07-8b28-4a6e6b17338a with Priority: HIGHEST for action port [ 994.628748] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.628903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.629173] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.629611] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.629725] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4f6034d-9ad4-409e-9b4a-d6ffaa597a63',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.630902] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.631209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.631397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.631620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.631854] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.633119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.633216] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.633405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.633522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.633639] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4f6034d-9ad4-409e-9b4a-d6ffaa597a63',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.634574] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-08058de8-daae-4c07-8b28-4a6e6b17338a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.635269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08058de8-daae-4c07-8b28-4a6e6b17338a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.636880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08058de8-daae-4c07-8b28-4a6e6b17338a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.636880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08058de8-daae-4c07-8b28-4a6e6b17338a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.636880] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08058de8-daae-4c07-8b28-4a6e6b17338a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.659578] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d in Status: SUCCESS [ 994.659851] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.816636] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.816745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.816804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.817066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.817194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.817327] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea332971-c82a-4d07-a6bf-7fd2100dfbbb already deleted. [ 994.817416] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea332971-c82a-4d07-a6bf-7fd2100dfbbb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.139918] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4f6034d-9ad4-409e-9b4a-d6ffaa597a63',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.141351] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.141506] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.141755] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08058de8-daae-4c07-8b28-4a6e6b17338a with status ACTIVE [ 995.142176] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.142337] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.142337] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.143159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.143159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.143159] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.143159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.143370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.144082] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.144082] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.144082] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.144082] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.144311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.144347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.144472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.144631] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08058de8-daae-4c07-8b28-4a6e6b17338a is going to be updated. [ 995.173333] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.173530] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.173609] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.173825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.173965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.174142] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08058de8-daae-4c07-8b28-4a6e6b17338a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.365177] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c in Status: SUCCESS [ 995.365605] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.464914] env[65136]: INFO networking_nsxv3.common.synchronization [req-915dd45e-fd8a-4020-9576-0c05cf04b012 req-f68d47e1-3390-4913-b752-9d8b2650cf01 tempest-ServerDiskConfigTestJSON-1818502390 tempest-ServerDiskConfigTestJSON-1818502390-project-member] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 995.466353] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 995.469690] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.469690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.469690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.469690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.469690] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.469690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.469690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.469690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.469690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.469690] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.651047] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4f6034d-9ad4-409e-9b4a-d6ffaa597a63',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.652898] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c in Status: SUCCESS [ 995.653691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.653691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.653845] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.654555] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.654555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.654555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.654555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.654768] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.654812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.654949] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.973061] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.973422] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.973665] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.973916] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.974101] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.974435] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.974670] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.974929] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.975205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.975365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.975584] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be updated. [ 996.009567] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.009567] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.009567] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.009567] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.009567] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.009567] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.009567] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.009567] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.009567] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.009567] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.009567] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.009567] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.011293] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.011293] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.011293] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.011293] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.018043] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.018043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.018043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.018043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.018043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.040024] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.040024] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 996.040024] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.040024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.040024] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-95d2d32f-64f8-4ba1-b5d7-eb5f34cada29 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.040024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-95d2d32f-64f8-4ba1-b5d7-eb5f34cada29" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.040024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-95d2d32f-64f8-4ba1-b5d7-eb5f34cada29" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.040024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-95d2d32f-64f8-4ba1-b5d7-eb5f34cada29" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.040024] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95d2d32f-64f8-4ba1-b5d7-eb5f34cada29',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.042365] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 996.159773] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.159773] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.159773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.159773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.160248] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.160248] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.160248] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 is going to be created. [ 996.189373] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.189567] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.189615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.189811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.190020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.206652] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 in Status: UNINITIALIZED for 2s [ 996.544051] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.544477] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.544582] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.545063] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.545335] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.545630] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 95d2d32f-64f8-4ba1-b5d7-eb5f34cada29 not found, creating... [ 996.546122] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.546416] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.546612] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.547008] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.548160] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.548716] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.549018] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.549702] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.549702] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.549885] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.550138] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 95d2d32f-64f8-4ba1-b5d7-eb5f34cada29 is going to be created. [ 996.577062] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.577452] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.577670] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.578105] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.578457] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.578796] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-95d2d32f-64f8-4ba1-b5d7-eb5f34cada29" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.663406] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c: rpc.has_security_group_logging(os_id): False [ 996.698882] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.699119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.699119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.699407] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.699535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.700810] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.700810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.700810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.700810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.700810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.700810] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c is going to be created. [ 996.800617] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.800837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.800837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.801024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.801475] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.815595] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c in Status: IN_PROGRESS for 2s [ 997.384424] env[65136]: INFO networking_nsxv3.common.synchronization [req-915dd45e-fd8a-4020-9576-0c05cf04b012 req-634b36f3-b992-42b9-9043-df4c20d040d4 service nova] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_rules [ 997.384623] env[65136]: INFO networking_nsxv3.common.synchronization [req-915dd45e-fd8a-4020-9576-0c05cf04b012 req-634b36f3-b992-42b9-9043-df4c20d040d4 service nova] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 997.384872] env[65136]: INFO networking_nsxv3.common.synchronization [req-915dd45e-fd8a-4020-9576-0c05cf04b012 req-634b36f3-b992-42b9-9043-df4c20d040d4 service nova] Enqueued Resource ID: 95d2d32f-64f8-4ba1-b5d7-eb5f34cada29 with Priority: HIGHEST for action port [ 997.384999] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_rules [ 997.386735] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 997.390020] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 95d2d32f-64f8-4ba1-b5d7-eb5f34cada29 with Priority: HIGHEST for action port [ 997.390020] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.390020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.390020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.390020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.390020] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.390020] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.390020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.390020] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-95d2d32f-64f8-4ba1-b5d7-eb5f34cada29 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.390020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-95d2d32f-64f8-4ba1-b5d7-eb5f34cada29" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.390020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-95d2d32f-64f8-4ba1-b5d7-eb5f34cada29" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.390020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-95d2d32f-64f8-4ba1-b5d7-eb5f34cada29" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.390020] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('95d2d32f-64f8-4ba1-b5d7-eb5f34cada29',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.879453] env[65136]: INFO networking_nsxv3.common.synchronization [req-49544709-0a16-495a-9852-2d3ecc8e59ed req-ca76e272-d71e-431a-8e76-cbdc361e22bf tempest-DeleteServersTestJSON-1045367082 tempest-DeleteServersTestJSON-1045367082-project-member] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 997.881123] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 997.881703] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.881832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.881894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.882167] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.882485] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.882891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.882976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.883172] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.883401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.883401] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.897026] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.897026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.897026] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 95d2d32f-64f8-4ba1-b5d7-eb5f34cada29 with status ACTIVE [ 997.897026] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.897026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.897026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.897026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.897026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.897026] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.897026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.897026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.897026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.897026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.897026] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.897748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.897748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.897748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.897748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.897748] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 95d2d32f-64f8-4ba1-b5d7-eb5f34cada29 is going to be updated. [ 997.932189] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.935421] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.935421] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.935704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.936057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.936057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-95d2d32f-64f8-4ba1-b5d7-eb5f34cada29" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.050023] env[65136]: INFO networking_nsxv3.common.synchronization [None req-7359e9d8-dbfa-4c8c-afce-3b3f7c1a08b8 tempest-ServerRescueNegativeTestJSON-1746403212 tempest-ServerRescueNegativeTestJSON-1746403212-project-member] Enqueued Resource ID: 0e10abd8-e332-4023-ac76-224c24377bec with Priority: HIGHEST for action security_group_rules [ 998.050023] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e10abd8-e332-4023-ac76-224c24377bec with Priority: HIGHEST for action security_group_rules [ 998.052784] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e10abd8-e332-4023-ac76-224c24377bec taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.052784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.052784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.052784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.052784] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e10abd8-e332-4023-ac76-224c24377bec',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.060691] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 998.060691] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d deletion is rescheduled due to dependency. [ 998.060846] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.060904] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.061154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.061481] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.061710] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.061846] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.062601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.062601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.062601] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.217273] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 in Status: UNINITIALIZED for 4s [ 998.260765] env[65136]: INFO networking_nsxv3.common.synchronization [None req-2305f19f-00fd-497d-8dbf-96433f06de04 tempest-ServerRescueNegativeTestJSON-1746403212 tempest-ServerRescueNegativeTestJSON-1746403212-project-member] Enqueued Resource ID: 0e10abd8-e332-4023-ac76-224c24377bec with Priority: HIGHEST for action security_group_rules [ 998.261687] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e10abd8-e332-4023-ac76-224c24377bec with Priority: HIGHEST for action security_group_rules [ 998.262196] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e10abd8-e332-4023-ac76-224c24377bec taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.262803] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.319215] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.319702] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.320207] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.320701] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.320866] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.321381] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.321799] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.321891] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.323466] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.323466] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.323466] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 998.323466] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 998.323466] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 998.323720] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 998.324078] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 998.324355] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 998.351026] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 998.351026] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 998.351026] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 998.351026] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.351026] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-f2a19ecf-f983-497d-b9c7-27fb749ecce2 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.351026] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-f2a19ecf-f983-497d-b9c7-27fb749ecce2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.351026] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-f2a19ecf-f983-497d-b9c7-27fb749ecce2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.351026] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-f2a19ecf-f983-497d-b9c7-27fb749ecce2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.351026] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2a19ecf-f983-497d-b9c7-27fb749ecce2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.386374] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.568652] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.578740] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.579019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.579019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.579159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.579246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.579430] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e10abd8-e332-4023-ac76-224c24377bec already deleted. [ 998.579514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.579676] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.579861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.580059] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e10abd8-e332-4023-ac76-224c24377bec',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.827782] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c in Status: SUCCESS [ 998.828053] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.852527] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.852853] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.853066] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.853395] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.853559] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.853718] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port f2a19ecf-f983-497d-b9c7-27fb749ecce2 not found, creating... [ 998.853986] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.854186] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.854306] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.854536] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.854877] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.855042] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.855180] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.855313] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.855581] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.855789] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.855981] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: f2a19ecf-f983-497d-b9c7-27fb749ecce2 is going to be created. [ 998.878915] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.879198] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.879277] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.879579] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.879818] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.880049] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-f2a19ecf-f983-497d-b9c7-27fb749ecce2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.890626] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.071841] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.106387] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.106595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.106595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.106803] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.106897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.107023] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e10abd8-e332-4023-ac76-224c24377bec already deleted. [ 999.107144] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.392936] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.393164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.393164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.393505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.393608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.393713] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 999.432565] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.432834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.432834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.433068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.433226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.444473] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 999.574384] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.574619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.574732] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.574905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.574998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.575111] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be updated. [ 999.606510] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.606510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.606637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.607018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.607285] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.616017] env[65136]: INFO networking_nsxv3.common.synchronization [req-49544709-0a16-495a-9852-2d3ecc8e59ed req-e8f4eb13-a94c-4422-9643-baf7b4777096 service nova] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_rules [ 999.616017] env[65136]: INFO networking_nsxv3.common.synchronization [req-49544709-0a16-495a-9852-2d3ecc8e59ed req-e8f4eb13-a94c-4422-9643-baf7b4777096 service nova] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 999.616208] env[65136]: INFO networking_nsxv3.common.synchronization [req-49544709-0a16-495a-9852-2d3ecc8e59ed req-e8f4eb13-a94c-4422-9643-baf7b4777096 service nova] Enqueued Resource ID: f2a19ecf-f983-497d-b9c7-27fb749ecce2 with Priority: HIGHEST for action port [ 999.617395] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 999.617996] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_rules [ 999.618984] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 999.618984] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2a19ecf-f983-497d-b9c7-27fb749ecce2 with Priority: HIGHEST for action port [ 999.618984] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.618984] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.618984] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.619281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.619807] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.621894] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.622056] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.622408] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2a19ecf-f983-497d-b9c7-27fb749ecce2 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.622555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2a19ecf-f983-497d-b9c7-27fb749ecce2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.622692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2a19ecf-f983-497d-b9c7-27fb749ecce2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.622976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2a19ecf-f983-497d-b9c7-27fb749ecce2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.623363] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2a19ecf-f983-497d-b9c7-27fb749ecce2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.122746] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.123754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.129392] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2a19ecf-f983-497d-b9c7-27fb749ecce2 with status ACTIVE [ 1000.129392] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.129392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.129392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.129392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.129392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.129392] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.129392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.129392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.129392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.129392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.129392] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.129392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.129392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.129392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.129392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.129392] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2a19ecf-f983-497d-b9c7-27fb749ecce2 is going to be updated. [ 1000.157286] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.157680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.157680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.158354] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.158494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.158852] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2a19ecf-f983-497d-b9c7-27fb749ecce2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.211576] env[65136]: INFO networking_nsxv3.common.synchronization [req-e086d86d-54c0-435a-b504-ad4c85f9fcfc req-a03f269c-024f-48ba-ab31-6cf673966e52 tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 1000.212700] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 1000.213148] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.213318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.213413] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.213675] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.213894] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.214055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.214152] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.214364] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.214483] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.214615] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.229416] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 in Status: SUCCESS [ 1000.229732] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.230484] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.230687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.230969] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.231162] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.231266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.231488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.231609] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.231725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.231843] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4f6034d-9ad4-409e-9b4a-d6ffaa597a63',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.687107] env[65136]: INFO networking_nsxv3.common.synchronization [req-b700fdcc-8eae-4da1-80c7-db5f203434fa req-304f8a6e-b35f-4028-96e9-23b263d619e6 tempest-ServersTestJSON-425456513 tempest-ServersTestJSON-425456513-project-member] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1000.687865] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1000.689489] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.689625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.689625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.689831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.689992] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.690107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.690170] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.690346] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.690441] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.690613] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.717139] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.737617] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4f6034d-9ad4-409e-9b4a-d6ffaa597a63',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.196369] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.220716] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.231252] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.231252] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.231485] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.231893] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.232390] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.232785] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.233045] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.233417] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.233792] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.236147] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.236147] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1001.236147] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1001.236147] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1001.236147] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.236147] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1001.236147] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1001.240506] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4f6034d-9ad4-409e-9b4a-d6ffaa597a63: rpc.has_security_group_logging(os_id): False [ 1001.267254] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1001.267254] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1001.267254] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1001.267254] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.267254] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-e5e7bc56-67a9-430f-a04c-17e4a15bf4ac taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.267254] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-e5e7bc56-67a9-430f-a04c-17e4a15bf4ac" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.267254] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-e5e7bc56-67a9-430f-a04c-17e4a15bf4ac" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.267254] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-e5e7bc56-67a9-430f-a04c-17e4a15bf4ac" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.267254] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5e7bc56-67a9-430f-a04c-17e4a15bf4ac',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.269949] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.270189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.270348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.270487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.270923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.270923] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.270923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.271300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.271300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.271440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.271440] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 is going to be created. [ 1001.319376] env[65136]: INFO networking_nsxv3.common.synchronization [None req-b5d7f0c2-3129-40fb-ac23-2e8884ebe095 None None] Enqueued Resource ID: 8256a6b9-6c78-4c1d-a15f-43c7d2befd19 with Priority: HIGHEST for action port [ 1001.320111] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8256a6b9-6c78-4c1d-a15f-43c7d2befd19 with Priority: HIGHEST for action port [ 1001.320434] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-8256a6b9-6c78-4c1d-a15f-43c7d2befd19 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.320600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8256a6b9-6c78-4c1d-a15f-43c7d2befd19" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.320688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8256a6b9-6c78-4c1d-a15f-43c7d2befd19" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.321019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8256a6b9-6c78-4c1d-a15f-43c7d2befd19" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.321128] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8256a6b9-6c78-4c1d-a15f-43c7d2befd19',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.375811] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.376024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.376148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.376401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.376594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.391473] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 in Status: IN_PROGRESS for 2s [ 1001.458207] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 1001.458351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.458534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.458872] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.459141] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.459270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.459416] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.459600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.459684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.459781] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.627184] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 1001.627625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.627625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.627909] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.628031] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.628347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.628347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.628347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.628551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.628551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.628633] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.700021] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.723292] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.723441] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.723540] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.723739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.723839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.723924] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be updated. [ 1001.755352] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.755550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.755654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.756014] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.756204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.767076] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: IN_PROGRESS for 2s [ 1001.773886] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.774238] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.774375] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.774661] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.774937] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.775023] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port e5e7bc56-67a9-430f-a04c-17e4a15bf4ac not found, creating... [ 1001.775241] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.775397] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.775525] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.775830] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.775894] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.776163] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.776319] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.776439] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.776645] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.776779] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.776986] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: e5e7bc56-67a9-430f-a04c-17e4a15bf4ac is going to be created. [ 1001.815270] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.815493] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.815638] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.815916] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.816233] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.816406] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-e5e7bc56-67a9-430f-a04c-17e4a15bf4ac" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.824110] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8256a6b9-6c78-4c1d-a15f-43c7d2befd19 [ 1001.824346] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.824695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.824695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.824782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.824820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.824912] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8256a6b9-6c78-4c1d-a15f-43c7d2befd19 already deleted. [ 1001.824990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8256a6b9-6c78-4c1d-a15f-43c7d2befd19" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.963691] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.130589] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.130842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.130919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.131201] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.131448] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.131573] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.131740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.131948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.132090] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.132226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.132431] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.132553] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.132627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.132785] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.132931] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.133035] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.133097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.133235] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.133313] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.133395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.133489] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.203026] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.203404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.203404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.203613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.203706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.203824] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1002.257668] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.257894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.257974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.258217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.258364] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.275846] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1002.470538] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.588834] env[65136]: INFO networking_nsxv3.common.synchronization [req-b700fdcc-8eae-4da1-80c7-db5f203434fa req-29257511-f0ef-4c01-af84-6677cdbde5c6 service nova] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_rules [ 1002.589174] env[65136]: INFO networking_nsxv3.common.synchronization [req-b700fdcc-8eae-4da1-80c7-db5f203434fa req-29257511-f0ef-4c01-af84-6677cdbde5c6 service nova] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1002.590223] env[65136]: INFO networking_nsxv3.common.synchronization [req-b700fdcc-8eae-4da1-80c7-db5f203434fa req-29257511-f0ef-4c01-af84-6677cdbde5c6 service nova] Enqueued Resource ID: e5e7bc56-67a9-430f-a04c-17e4a15bf4ac with Priority: HIGHEST for action port [ 1002.591761] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_rules [ 1002.591998] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1002.592209] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e7bc56-67a9-430f-a04c-17e4a15bf4ac with Priority: HIGHEST for action port [ 1002.593251] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.593466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.593558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.594048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.594048] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.594878] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.594982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.595202] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5e7bc56-67a9-430f-a04c-17e4a15bf4ac taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.595305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5e7bc56-67a9-430f-a04c-17e4a15bf4ac" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.595370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5e7bc56-67a9-430f-a04c-17e4a15bf4ac" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.595550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5e7bc56-67a9-430f-a04c-17e4a15bf4ac" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.595626] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5e7bc56-67a9-430f-a04c-17e4a15bf4ac',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.635218] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605661ba-c8c2-4dae-8382-f55a5d1ead5d: rpc.has_security_group_logging(os_id): False [ 1002.656199] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.656373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.657462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.657462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.657462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.657462] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.657462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.657462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.657462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.657462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.657861] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.657861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.657861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.657861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.657861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.658017] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.659196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.659196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.659196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.659196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.659196] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be updated. [ 1002.747715] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.747715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.747715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.747715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.748015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.766098] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 1002.974619] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.974619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.974619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.974619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.974619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.974619] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 1003.009745] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.009745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.009745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.009745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.009745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.023883] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 1003.097733] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.097733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.101257] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5e7bc56-67a9-430f-a04c-17e4a15bf4ac with status ACTIVE [ 1003.101897] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.101897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.101897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.102121] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.102121] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.102312] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.102416] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.102482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.102572] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.102646] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.102999] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.102999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.102999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.103307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.103307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.103307] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5e7bc56-67a9-430f-a04c-17e4a15bf4ac is going to be updated. [ 1003.106029] env[65136]: INFO networking_nsxv3.common.synchronization [None req-6e84a38f-9e74-4847-81b9-630b18ea35d3 tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 1003.107250] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 1003.108129] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.108129] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.131218] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.131373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.131449] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.132185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.132185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.132185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5e7bc56-67a9-430f-a04c-17e4a15bf4ac" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.409282] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 in Status: SUCCESS [ 1003.409282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.784060] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 1003.784311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.787504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.787801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.788036] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.788174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.788239] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.788401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.788481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.788634] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.178698] env[65136]: INFO networking_nsxv3.common.synchronization [None req-7c9df84b-d957-4ef6-b4d4-ba9e06cf9fea None None] Enqueued Resource ID: 540d872b-a1e4-4748-8da4-7be5a72d973f with Priority: HIGHEST for action port [ 1004.179427] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 540d872b-a1e4-4748-8da4-7be5a72d973f with Priority: HIGHEST for action port [ 1004.179822] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-540d872b-a1e4-4748-8da4-7be5a72d973f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.179963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-540d872b-a1e4-4748-8da4-7be5a72d973f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.180054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-540d872b-a1e4-4748-8da4-7be5a72d973f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.180388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-540d872b-a1e4-4748-8da4-7be5a72d973f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.180504] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('540d872b-a1e4-4748-8da4-7be5a72d973f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.292393] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1004.292895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.293058] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.293127] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.293573] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.293573] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.293573] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.293803] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.293803] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.293803] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.293972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.294125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.294125] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be updated. [ 1004.295600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.295780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.295961] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.296090] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.296166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.296325] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.296375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.296458] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.344997] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.344997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.344997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.344997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.344997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.355271] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: IN_PROGRESS for 2s [ 1004.682865] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 540d872b-a1e4-4748-8da4-7be5a72d973f [ 1004.683207] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.683353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.683424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.683936] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.684081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.684241] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:540d872b-a1e4-4748-8da4-7be5a72d973f already deleted. [ 1004.684417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-540d872b-a1e4-4748-8da4-7be5a72d973f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.779751] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 1004.779977] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.800157] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.034538] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 1005.037054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.037054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.037054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.037054] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.037054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.037054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.037054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.037054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.037054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.037054] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.302206] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.541602] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.542166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.542166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.543018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.543379] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.544368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.544368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.544368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.544368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.544368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.544664] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.544728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.544884] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.545666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.545768] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.545985] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.546145] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.546432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.546500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.546563] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.546754] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.805897] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.806288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.806288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.806510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.806613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.806721] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1005.842842] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.842842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.842842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.844446] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.844446] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.855047] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1006.051950] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5ef8f7d-8350-4fe2-9bef-70ff70b5f141: rpc.has_security_group_logging(os_id): False [ 1006.071624] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.071849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.071849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.072431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.072431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.072599] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.072756] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.072900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.073189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.073328] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.073850] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.073850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.073850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.074027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.074027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.074543] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.074543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.074543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.074756] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.074830] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.074903] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 1006.166086] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.166338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.166396] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.166619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.166769] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.186033] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 1006.366445] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 1006.366680] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde deletion is rescheduled due to dependency. [ 1006.366799] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.984031] env[65136]: INFO networking_nsxv3.common.synchronization [req-84f17e98-e629-40c2-9074-10b70fc2cfaf req-03ec9434-3984-4f35-84a6-05dc7e102107 tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 with Priority: HIGHEST for action security_group_members [ 1006.984357] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 with Priority: HIGHEST for action security_group_members [ 1006.984535] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.985149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.985149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.985149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.985448] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.985647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.985716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.985904] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.986015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.986111] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbc78997-cbe5-4eed-9a43-9c7f00c61ec1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.045961] env[65136]: INFO networking_nsxv3.common.synchronization [req-8778864f-6c01-4573-83ef-b9992aef2d75 req-1be012bf-6595-4eda-bc3b-db33e974f3fb tempest-ServerRescueNegativeTestJSON-1746403212 tempest-ServerRescueNegativeTestJSON-1746403212-project-member] Enqueued Resource ID: 0e10abd8-e332-4023-ac76-224c24377bec with Priority: HIGHEST for action security_group_members [ 1007.047044] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e10abd8-e332-4023-ac76-224c24377bec with Priority: HIGHEST for action security_group_members [ 1007.047420] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e10abd8-e332-4023-ac76-224c24377bec taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.047542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.047903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.048275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.048390] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.048474] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.048526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.048684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.048794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.048915] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e10abd8-e332-4023-ac76-224c24377bec',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.453522] env[65136]: INFO networking_nsxv3.common.synchronization [req-b9a3f519-32dc-4b4e-994f-a2e99b491649 req-ad3811e3-b431-4268-a90f-f94ffd528d15 tempest-ImagesTestJSON-1051903205 tempest-ImagesTestJSON-1051903205-project-member] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 1007.454439] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 1007.454787] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.454913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.455045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.455238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.455396] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.455517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.455581] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.455733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.455820] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.455936] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.489919] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.489919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.490153] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.490188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.514252] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.515167] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.515337] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.515448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.515683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.515838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.515892] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 is going to be updated. [ 1007.551735] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-380 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.552368] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-380" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.552669] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-380" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.553123] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-380" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.553451] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.553729] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.553904] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.554190] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.554400] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.554687] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1007.554845] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1007.554996] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1007.555172] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1007.555346] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1007.555506] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1007.556330] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1007.557637] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.558164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.558278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.558493] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.558583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.558881] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.558999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.559084] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.559269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.559367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.559460] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e10abd8-e332-4023-ac76-224c24377bec already deleted. [ 1007.559553] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.573515] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.573776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.573935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.574249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.574590] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.583720] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1007.584204] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1007.584628] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1007.584953] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-380" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.585433] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-e355c37c-580d-48ee-b1e7-4ef0a32f7ea9 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.585753] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-e355c37c-580d-48ee-b1e7-4ef0a32f7ea9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.585972] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-e355c37c-580d-48ee-b1e7-4ef0a32f7ea9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.587422] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-e355c37c-580d-48ee-b1e7-4ef0a32f7ea9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.587422] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e355c37c-580d-48ee-b1e7-4ef0a32f7ea9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.592031] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 in Status: IN_PROGRESS for 2s [ 1007.878230] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1007.878544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.878855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.878954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.879162] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.879284] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.879453] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.879627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.879709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.879796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.879888] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.958269] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.958498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.958580] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.958799] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.958910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.959123] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.959230] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.959281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.959475] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.959551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.959632] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 1008.007542] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.007886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.007886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.008266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.008409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.020835] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 1008.091460] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.092275] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.092886] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.092886] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.093064] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.093225] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port e355c37c-580d-48ee-b1e7-4ef0a32f7ea9 not found, creating... [ 1008.093499] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.093670] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.093786] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.094028] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.094167] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.094453] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.094608] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.094730] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.094937] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.095452] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.096844] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: e355c37c-580d-48ee-b1e7-4ef0a32f7ea9 is going to be created. [ 1008.122162] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.122384] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.122508] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.122799] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.123034] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.124714] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-e355c37c-580d-48ee-b1e7-4ef0a32f7ea9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.202638] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 1008.202996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.385445] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.385715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.385794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.386052] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.386293] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.386443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.386518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.386661] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.386751] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.386851] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.387398] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.387505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.387548] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.387696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.387841] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.387928] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.387993] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.388174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.388283] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.388419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.388481] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.891200] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a99f7e35-ad71-4640-a081-3c507e997901: rpc.has_security_group_logging(os_id): False [ 1008.902357] env[65136]: INFO networking_nsxv3.common.synchronization [req-8778864f-6c01-4573-83ef-b9992aef2d75 req-1bfbd55c-b2c0-413b-b9de-76b448c4ede3 service nova] Enqueued Resource ID: 0e10abd8-e332-4023-ac76-224c24377bec with Priority: HIGHEST for action security_group_rules [ 1008.902357] env[65136]: INFO networking_nsxv3.common.synchronization [req-8778864f-6c01-4573-83ef-b9992aef2d75 req-1bfbd55c-b2c0-413b-b9de-76b448c4ede3 service nova] Enqueued Resource ID: 0e10abd8-e332-4023-ac76-224c24377bec with Priority: HIGHEST for action security_group_members [ 1008.902357] env[65136]: INFO networking_nsxv3.common.synchronization [req-8778864f-6c01-4573-83ef-b9992aef2d75 req-1bfbd55c-b2c0-413b-b9de-76b448c4ede3 service nova] Enqueued Resource ID: e355c37c-580d-48ee-b1e7-4ef0a32f7ea9 with Priority: HIGHEST for action port [ 1008.902357] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e10abd8-e332-4023-ac76-224c24377bec with Priority: HIGHEST for action security_group_rules [ 1008.903248] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e10abd8-e332-4023-ac76-224c24377bec with Priority: HIGHEST for action security_group_members [ 1008.903248] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e355c37c-580d-48ee-b1e7-4ef0a32f7ea9 with Priority: HIGHEST for action port [ 1008.903428] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e10abd8-e332-4023-ac76-224c24377bec taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.903581] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.903629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.905234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.905234] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e10abd8-e332-4023-ac76-224c24377bec',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.905234] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e10abd8-e332-4023-ac76-224c24377bec taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.905529] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.905618] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.907455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.907455] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.907455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.907455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.907455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.907455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.907455] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e10abd8-e332-4023-ac76-224c24377bec',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.907880] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-e355c37c-580d-48ee-b1e7-4ef0a32f7ea9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.907974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e355c37c-580d-48ee-b1e7-4ef0a32f7ea9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.908333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e355c37c-580d-48ee-b1e7-4ef0a32f7ea9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.908333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e355c37c-580d-48ee-b1e7-4ef0a32f7ea9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.908468] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e355c37c-580d-48ee-b1e7-4ef0a32f7ea9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.917962] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.917962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.917962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.918716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.918826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.919071] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.919197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.919197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.919436] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.919538] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.923028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.923028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.923028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.923028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.923028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.923028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.923028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.923028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.923028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.923028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.923028] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1009.015343] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.015343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.015343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.015343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.015343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.031885] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1009.338687] env[65136]: INFO networking_nsxv3.common.synchronization [req-63b00bd8-9be5-4d7f-9ba9-e84cc0073ffe req-797847a4-ddef-4107-ab9b-6beef4bcf02a tempest-ServerPasswordTestJSON-692681360 tempest-ServerPasswordTestJSON-692681360-project-member] Enqueued Resource ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc with Priority: HIGHEST for action security_group_members [ 1009.339272] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc with Priority: HIGHEST for action security_group_members [ 1009.339659] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.339790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.339873] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.344018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.344182] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.344336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.344411] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.344639] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.344758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.344874] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.410923] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e10abd8-e332-4023-ac76-224c24377bec taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.412091] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.412290] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e10abd8-e332-4023-ac76-224c24377bec',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.413610] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e355c37c-580d-48ee-b1e7-4ef0a32f7ea9 with status ACTIVE [ 1009.413910] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.414114] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.414241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.414809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.414944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.415235] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.415394] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.415497] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.415948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.416088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.416447] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.416547] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.416602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.416859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.416917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.417042] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e355c37c-580d-48ee-b1e7-4ef0a32f7ea9 is going to be updated. [ 1009.443590] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.443844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.443844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.444046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.444160] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.444327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e355c37c-580d-48ee-b1e7-4ef0a32f7ea9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.602685] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 in Status: SUCCESS [ 1009.603693] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 deletion is rescheduled due to dependency. [ 1009.603693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.763429] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-962 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.763778] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-962" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.763966] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-962" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.764381] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-962" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.764748] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.764931] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.765075] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.765314] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.765459] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.765736] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.765863] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.765975] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.766127] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.766243] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.766355] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.766906] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.789319] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.789594] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1009.789738] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.789889] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-962" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.790248] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-106f1abf-0c1f-4c52-9740-d037bf599268 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.790447] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-106f1abf-0c1f-4c52-9740-d037bf599268" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.790572] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-106f1abf-0c1f-4c52-9740-d037bf599268" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.790905] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-106f1abf-0c1f-4c52-9740-d037bf599268" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.791076] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('106f1abf-0c1f-4c52-9740-d037bf599268',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.847212] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.847429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.847490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.847702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.847795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.847994] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.848102] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.848162] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.848312] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.848395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.848482] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc already deleted. [ 1009.848563] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.919887] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e10abd8-e332-4023-ac76-224c24377bec',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.035046] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 1010.035322] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 deletion is rescheduled due to dependency. [ 1010.035359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.293540] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.294246] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.294246] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.294352] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.294486] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.294643] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 106f1abf-0c1f-4c52-9740-d037bf599268 not found, creating... [ 1010.294906] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.295076] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.295197] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.295420] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.295552] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.295837] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.295993] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.296125] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.296330] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.296527] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.296683] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 106f1abf-0c1f-4c52-9740-d037bf599268 is going to be created. [ 1010.322951] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.324358] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.324523] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.324809] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.325074] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.325320] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-106f1abf-0c1f-4c52-9740-d037bf599268" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.423019] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.423019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.423019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.423019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.423019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.423019] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e10abd8-e332-4023-ac76-224c24377bec is going to be created. [ 1010.473448] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.473632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.473713] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.473948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.474139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.485594] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e10abd8-e332-4023-ac76-224c24377bec in Status: UNINITIALIZED for 2s [ 1011.048201] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1011.048527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.071065] env[65136]: INFO networking_nsxv3.common.synchronization [req-63b00bd8-9be5-4d7f-9ba9-e84cc0073ffe req-cc878b93-cb9e-4b42-8ed6-119cb014213a service nova] Enqueued Resource ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc with Priority: HIGHEST for action security_group_rules [ 1011.071207] env[65136]: INFO networking_nsxv3.common.synchronization [req-63b00bd8-9be5-4d7f-9ba9-e84cc0073ffe req-cc878b93-cb9e-4b42-8ed6-119cb014213a service nova] Enqueued Resource ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc with Priority: HIGHEST for action security_group_members [ 1011.071658] env[65136]: INFO networking_nsxv3.common.synchronization [req-63b00bd8-9be5-4d7f-9ba9-e84cc0073ffe req-cc878b93-cb9e-4b42-8ed6-119cb014213a service nova] Enqueued Resource ID: 106f1abf-0c1f-4c52-9740-d037bf599268 with Priority: HIGHEST for action port [ 1011.071914] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc with Priority: HIGHEST for action security_group_rules [ 1011.072127] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc with Priority: HIGHEST for action security_group_members [ 1011.072262] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 106f1abf-0c1f-4c52-9740-d037bf599268 with Priority: HIGHEST for action port [ 1011.072579] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.072704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.072771] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.073031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.073124] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.074195] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.074195] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.074195] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.074387] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.075143] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.075143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.075143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.075356] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.075412] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.075644] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.076459] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-106f1abf-0c1f-4c52-9740-d037bf599268 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.076580] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-106f1abf-0c1f-4c52-9740-d037bf599268" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.076683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-106f1abf-0c1f-4c52-9740-d037bf599268" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.076788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-106f1abf-0c1f-4c52-9740-d037bf599268" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.076866] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('106f1abf-0c1f-4c52-9740-d037bf599268',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.579483] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.580664] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.580815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.581068] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 106f1abf-0c1f-4c52-9740-d037bf599268 with status ACTIVE [ 1011.581271] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.581414] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.581506] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.581761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.581868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.582094] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.582221] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.582305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.582509] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.582611] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.582828] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.582957] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.583050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.583388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.583388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.583481] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 106f1abf-0c1f-4c52-9740-d037bf599268 is going to be updated. [ 1011.613977] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.614119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.614235] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.614530] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.614607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.614731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-106f1abf-0c1f-4c52-9740-d037bf599268" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.750252] env[65136]: INFO networking_nsxv3.common.synchronization [req-0b5e0cdc-7ea7-40d4-a034-a7544bfb06f5 req-58eef11d-e745-484f-b3e0-3ed4634f60fa tempest-ImagesTestJSON-1051903205 tempest-ImagesTestJSON-1051903205-project-member] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 1011.750252] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 1011.750252] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.750252] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.750252] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.750486] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.750607] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.750750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.750981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.751324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.751534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.753060] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.086884] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.145033] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-63 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.145033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.145033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.145033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.145033] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.145033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.145033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.145578] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.145871] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.146204] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.146427] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.146638] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.146878] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.147133] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.147428] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.147682] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.168354] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.168870] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1012.171019] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.171019] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.171019] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-a8e58ca3-e287-457a-8a98-6604b88fc8f3 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.171019] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-a8e58ca3-e287-457a-8a98-6604b88fc8f3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.171019] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-a8e58ca3-e287-457a-8a98-6604b88fc8f3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.171019] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-a8e58ca3-e287-457a-8a98-6604b88fc8f3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.171019] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8e58ca3-e287-457a-8a98-6604b88fc8f3',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.264026] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.264026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.264026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.264026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.264026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.264026] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.264026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.264026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.264026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.264026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.264026] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 1012.296388] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.296637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.296637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.296816] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.296963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.313019] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 1012.497257] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e10abd8-e332-4023-ac76-224c24377bec in Status: SUCCESS [ 1012.497656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.498124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.498192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.498440] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.498545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.498611] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.498783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.498890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.498980] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.499091] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e10abd8-e332-4023-ac76-224c24377bec',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.588640] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.588827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.588899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.589237] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.589278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.589397] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc is going to be created. [ 1012.615251] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.615493] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.615641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.615940] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.616224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.628788] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc in Status: UNINITIALIZED for 2s [ 1012.674148] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.674464] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.674603] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.675030] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.675149] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.675314] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port a8e58ca3-e287-457a-8a98-6604b88fc8f3 not found, creating... [ 1012.675622] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.675799] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.675908] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.676180] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.676334] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.676666] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.676849] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.676964] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.677187] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.677342] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.677499] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: a8e58ca3-e287-457a-8a98-6604b88fc8f3 is going to be created. [ 1012.698956] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.699193] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.699420] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.699615] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.699850] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.700081] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-a8e58ca3-e287-457a-8a98-6604b88fc8f3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.002828] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e10abd8-e332-4023-ac76-224c24377bec',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.423048] env[65136]: INFO networking_nsxv3.common.synchronization [req-0b5e0cdc-7ea7-40d4-a034-a7544bfb06f5 req-2178dfe1-80b5-4117-b8c9-5d7eb891b8de service nova] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_rules [ 1013.423284] env[65136]: INFO networking_nsxv3.common.synchronization [req-0b5e0cdc-7ea7-40d4-a034-a7544bfb06f5 req-2178dfe1-80b5-4117-b8c9-5d7eb891b8de service nova] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 1013.423391] env[65136]: INFO networking_nsxv3.common.synchronization [req-0b5e0cdc-7ea7-40d4-a034-a7544bfb06f5 req-2178dfe1-80b5-4117-b8c9-5d7eb891b8de service nova] Enqueued Resource ID: a8e58ca3-e287-457a-8a98-6604b88fc8f3 with Priority: HIGHEST for action port [ 1013.423916] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_rules [ 1013.424043] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 1013.424690] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8e58ca3-e287-457a-8a98-6604b88fc8f3 with Priority: HIGHEST for action port [ 1013.424787] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.425011] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.425169] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.425500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.425602] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.426549] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.426687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.426994] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8e58ca3-e287-457a-8a98-6604b88fc8f3 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.427490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8e58ca3-e287-457a-8a98-6604b88fc8f3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.427568] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8e58ca3-e287-457a-8a98-6604b88fc8f3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.427758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8e58ca3-e287-457a-8a98-6604b88fc8f3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.427860] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8e58ca3-e287-457a-8a98-6604b88fc8f3',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.505282] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e10abd8-e332-4023-ac76-224c24377bec: rpc.has_security_group_logging(os_id): False [ 1013.523287] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.523468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.523534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.523745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.523838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.524106] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.524207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.524325] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.524417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.524588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.524588] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e10abd8-e332-4023-ac76-224c24377bec is going to be created. [ 1013.591148] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.591302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.591383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.591853] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.592221] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.604877] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e10abd8-e332-4023-ac76-224c24377bec in Status: IN_PROGRESS for 2s [ 1013.930930] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.930930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.930930] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8e58ca3-e287-457a-8a98-6604b88fc8f3 with status ACTIVE [ 1013.930930] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.930930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.930930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.930930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.931509] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.931509] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.931509] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.931509] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.931684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.931779] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.931966] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.932077] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.932140] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.932281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.932367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.932453] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8e58ca3-e287-457a-8a98-6604b88fc8f3 is going to be updated. [ 1013.956229] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.956405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.956469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.956777] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.956927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.957135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8e58ca3-e287-457a-8a98-6604b88fc8f3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.328272] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 1014.328272] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 deletion is rescheduled due to dependency. [ 1014.328272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.328272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.328522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.328729] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.330460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.330736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.331212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.331496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.331851] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.443280] env[65136]: INFO networking_nsxv3.common.synchronization [None req-670306b5-e7a0-4412-b5b8-8df8b82c2e63 tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_rules [ 1014.443960] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_rules [ 1014.444338] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.444486] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.444560] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.444896] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.445016] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.534602] env[65136]: INFO networking_nsxv3.common.synchronization [None req-1e7dc865-2152-415b-96a0-0e01f757187d tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_rules [ 1014.535156] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_rules [ 1014.535466] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.535572] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.638891] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc in Status: SUCCESS [ 1014.639142] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.640404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.640404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.640404] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.640404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.640404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.640404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.640404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.640698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.640698] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.834735] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.966401] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.966545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.966619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.966830] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.966920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.967028] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e already deleted. [ 1014.967114] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.967281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.967449] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.967533] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.143579] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.143579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.143579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.143579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.143855] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.143855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.143987] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.144275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.144275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.144275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.144432] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.144563] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.144594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.144737] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.144923] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.144972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.145844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.145844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.145844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.145844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.145844] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.337949] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.491332] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.491684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.491684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.492292] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.492292] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.492292] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e already deleted. [ 1015.492292] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.590034] env[65136]: INFO networking_nsxv3.common.synchronization [req-0bb939ee-6472-4741-ae6c-fe2f729acc70 req-8bd8902f-c72f-4292-b173-f5722f634e0f tempest-ServersTestJSON-425456513 tempest-ServersTestJSON-425456513-project-member] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1015.590679] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1015.590997] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.591137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.591233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.591460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.591612] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.591739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.591839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.591983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.592081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.592178] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.618625] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e10abd8-e332-4023-ac76-224c24377bec in Status: SUCCESS [ 1015.618625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.648190] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc: rpc.has_security_group_logging(os_id): False [ 1015.671094] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.671253] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.671323] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.671591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.671725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.671894] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.671999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.672079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.672238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.672317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.672499] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.672595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.672658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.672801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.672876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.673085] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.673175] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.673224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.673367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.673444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.673529] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc is going to be created. [ 1015.741459] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.741749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.741825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.742026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.742214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.756786] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc in Status: IN_PROGRESS for 2s [ 1015.825246] env[65136]: INFO networking_nsxv3.common.synchronization [req-b8106e95-b92e-4d24-b52d-84e0aa564dcb req-47dd513d-a28c-486a-b3b8-782ac4f77212 tempest-DeleteServersTestJSON-1045367082 tempest-DeleteServersTestJSON-1045367082-project-member] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 1015.827191] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 1015.827789] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.827921] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.827970] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.828216] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.828373] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.828479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.828549] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.828724] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.828851] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.828957] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.840634] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.840838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.840905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.841136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.841227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.841343] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 1015.905255] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.905255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.905255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.905255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.905255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.912991] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 1016.095024] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.277536] env[65136]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1016.277536] env[65136]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1016.332211] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.597253] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.835158] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.100542] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.100721] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.100790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.101071] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.101183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.101294] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1017.128506] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.128731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.128792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.128984] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.129156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.142722] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1017.338212] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.338428] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.338505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.338793] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.338916] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.339022] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 1017.424461] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.424652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.424734] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.424899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.425020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.434530] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 1017.770257] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc in Status: SUCCESS [ 1017.771147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.924941] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 1017.925278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.925474] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.925927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.926244] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.926531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.926650] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.926867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.926968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.927092] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.927200] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.435205] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.435205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.435205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.435205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.435205] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.435205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.435205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.435205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.435205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.435205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.435205] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.435205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.435205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.435205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.435205] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.437410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.437410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.437410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.437410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.437410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.437410] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.938393] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15: rpc.has_security_group_logging(os_id): False [ 1018.957103] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.957103] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.957103] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.957467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.957467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.957467] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.957686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.957686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.958059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.958059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.958491] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.958491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.958815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.958815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.958815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.958973] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.959065] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.959065] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.959196] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.959258] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.959345] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 1019.021979] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.021979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.021979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.021979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.021979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.036518] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 1019.154326] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1019.155038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.445840] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 1019.446090] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.719951] env[65136]: INFO networking_nsxv3.common.synchronization [req-4293c0d3-e965-4d38-a0b9-676c5a5f17ab req-03969ab1-25e1-4ea8-a581-cf8a42c15f59 tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_members [ 1020.720593] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_members [ 1020.720880] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.725051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.725051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.725051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.725269] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.725328] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.725527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.726153] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.726153] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.726153] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.051035] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 1021.051262] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.053297] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-998 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.053520] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.053609] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.053887] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.054161] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.054320] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.054437] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.054645] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.054784] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.054998] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.055166] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.055283] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.055414] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.055529] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.055638] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.055819] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.075156] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.075336] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1021.075471] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.075650] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.075969] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-117f4ffd-321e-4e60-b74e-684bc5d4758d taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.076159] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-117f4ffd-321e-4e60-b74e-684bc5d4758d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.076279] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-117f4ffd-321e-4e60-b74e-684bc5d4758d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.076635] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-117f4ffd-321e-4e60-b74e-684bc5d4758d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.076776] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('117f4ffd-321e-4e60-b74e-684bc5d4758d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.229523] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.229722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.229885] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.230779] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.230779] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.230779] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.230779] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.230779] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.230779] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.231109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.231109] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e already deleted. [ 1021.231109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.579739] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.579991] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.580133] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.580447] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.580604] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.580779] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 117f4ffd-321e-4e60-b74e-684bc5d4758d not found, creating... [ 1021.581060] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.581223] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.581342] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.581567] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.581708] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.581987] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.582158] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.582276] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.582482] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.582620] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.582759] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 117f4ffd-321e-4e60-b74e-684bc5d4758d is going to be created. [ 1021.601958] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.602173] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.602307] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.602555] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.602782] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.603014] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-117f4ffd-321e-4e60-b74e-684bc5d4758d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.376616] env[65136]: INFO networking_nsxv3.common.synchronization [req-4293c0d3-e965-4d38-a0b9-676c5a5f17ab req-dc1a45df-1981-4cb0-adc2-b6e965355e86 service nova] Enqueued Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_rules [ 1022.376965] env[65136]: INFO networking_nsxv3.common.synchronization [req-4293c0d3-e965-4d38-a0b9-676c5a5f17ab req-dc1a45df-1981-4cb0-adc2-b6e965355e86 service nova] Enqueued Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_members [ 1022.377275] env[65136]: INFO networking_nsxv3.common.synchronization [req-4293c0d3-e965-4d38-a0b9-676c5a5f17ab req-dc1a45df-1981-4cb0-adc2-b6e965355e86 service nova] Enqueued Resource ID: 117f4ffd-321e-4e60-b74e-684bc5d4758d with Priority: HIGHEST for action port [ 1022.377997] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_rules [ 1022.379851] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_members [ 1022.380344] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 117f4ffd-321e-4e60-b74e-684bc5d4758d with Priority: HIGHEST for action port [ 1022.380344] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.380545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.380545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.383921] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.383921] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.383921] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.383921] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.383921] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.383921] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.383921] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.383921] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.383921] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.384359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.384359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.384359] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.387210] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-117f4ffd-321e-4e60-b74e-684bc5d4758d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.387403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-117f4ffd-321e-4e60-b74e-684bc5d4758d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.387403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-117f4ffd-321e-4e60-b74e-684bc5d4758d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.387618] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-117f4ffd-321e-4e60-b74e-684bc5d4758d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.388137] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('117f4ffd-321e-4e60-b74e-684bc5d4758d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.781034] env[65136]: INFO networking_nsxv3.common.synchronization [req-226dd4d3-d831-4fe3-a6ef-3d85d6fe5226 req-2d524ff2-7512-4e03-a03a-67584ae21b6b tempest-ServerActionsTestJSON-513195432 tempest-ServerActionsTestJSON-513195432-project-member] Enqueued Resource ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e with Priority: HIGHEST for action security_group_members [ 1022.781034] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e with Priority: HIGHEST for action security_group_members [ 1022.781034] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2c51c2cd-9219-40af-b979-dfebe3666f2e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.782353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.782353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.782353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.782485] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.782537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.783119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.783119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.783119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.783119] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2c51c2cd-9219-40af-b979-dfebe3666f2e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.891226] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.892746] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.893061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.893745] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 117f4ffd-321e-4e60-b74e-684bc5d4758d with status ACTIVE [ 1022.893745] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.893745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.893978] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.895536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.895536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.895536] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.895536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.895536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.895536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.895536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.895536] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.895536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.896378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.896378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.896378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.896493] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 117f4ffd-321e-4e60-b74e-684bc5d4758d is going to be updated. [ 1022.933573] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.933773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.933851] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.934382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.934382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.934620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-117f4ffd-321e-4e60-b74e-684bc5d4758d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.285367] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.285588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.285665] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.285900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.311229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.311505] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.311677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.311765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.311997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.312101] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.312194] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e is going to be updated. [ 1023.319704] env[65136]: INFO networking_nsxv3.common.synchronization [req-716e0b04-87d8-483a-856c-d02fe9062fa2 req-9c298851-0d4a-4ac7-8baf-1031c8169464 tempest-ServerPasswordTestJSON-692681360 tempest-ServerPasswordTestJSON-692681360-project-member] Enqueued Resource ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc with Priority: HIGHEST for action security_group_members [ 1023.320633] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc with Priority: HIGHEST for action security_group_members [ 1023.321910] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.321910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.321910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.321910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.321910] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.321910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.321910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.322774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.322869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.322972] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.352036] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.352036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.352036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.352036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.352036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.364075] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e in Status: IN_PROGRESS for 2s [ 1023.399121] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.826980] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.827180] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.827258] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.828072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.828072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.828072] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.828072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.828072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.828341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.828341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.828410] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc is going to be updated. [ 1023.861859] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.862047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.862047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.862257] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.862403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.872822] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc in Status: IN_PROGRESS for 2s [ 1023.902228] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.902353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.902414] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.902639] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.902731] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.902834] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e is going to be created. [ 1023.929254] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.929469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.929469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.929667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.929848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.940219] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e in Status: UNINITIALIZED for 2s [ 1025.378520] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e in Status: SUCCESS [ 1025.378520] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e deletion is rescheduled due to dependency. [ 1025.378520] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.886032] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc in Status: SUCCESS [ 1025.886249] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc deletion is rescheduled due to dependency. [ 1025.886322] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.955069] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e in Status: SUCCESS [ 1025.955308] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.955538] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.955754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.955987] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.956138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.956222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.956441] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.956530] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.956630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.957598] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.459273] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.961692] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb9ff62c-64bb-4ec0-8e08-87a27863a22e: rpc.has_security_group_logging(os_id): False [ 1026.981647] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.981843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.981946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.982391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.982543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.982834] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.982998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.983240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.983488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.983677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.983879] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e is going to be created. [ 1027.062940] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.063130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.063179] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.063391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.063717] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.080585] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e in Status: IN_PROGRESS for 2s [ 1027.578717] env[65136]: INFO networking_nsxv3.common.synchronization [req-7ce524d5-718b-4871-9aef-197ee575ba1f req-0b1a60fa-d761-4a65-9bba-3ca5a37c4d95 tempest-ServersTestJSON-425456513 tempest-ServersTestJSON-425456513-project-member] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1027.579072] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1027.580512] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.582267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.582419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.582710] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.582954] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.583099] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.583178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.583338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.583421] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.583522] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.934812] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.935027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.935156] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.935422] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.935673] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.935827] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.935942] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.936160] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.936300] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.936525] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.936635] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.936746] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.936855] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.936962] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.937080] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.937499] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.958117] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.958357] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1027.958448] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.958710] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.959052] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-41353864-9260-4412-8af2-68cfcc1c3efd taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.959226] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-41353864-9260-4412-8af2-68cfcc1c3efd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.959350] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-41353864-9260-4412-8af2-68cfcc1c3efd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.959698] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-41353864-9260-4412-8af2-68cfcc1c3efd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.959846] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41353864-9260-4412-8af2-68cfcc1c3efd',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.085708] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.462712] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.463099] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.463294] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.463618] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.463809] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.464040] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 41353864-9260-4412-8af2-68cfcc1c3efd not found, creating... [ 1028.464398] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.464588] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.464693] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.464928] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.465254] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.465611] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.465884] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.466119] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.466421] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.466618] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.466780] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 41353864-9260-4412-8af2-68cfcc1c3efd is going to be created. [ 1028.495037] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.495037] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.495037] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.495340] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.495467] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.495672] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-41353864-9260-4412-8af2-68cfcc1c3efd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.523330] env[65136]: INFO networking_nsxv3.common.synchronization [req-82e4a897-f4c7-41fa-aecd-da100b14538f req-800a3088-029f-4a06-84ae-ea1b789fd99d tempest-AttachVolumeNegativeTest-40195811 tempest-AttachVolumeNegativeTest-40195811-project-member] Enqueued Resource ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 with Priority: HIGHEST for action security_group_members [ 1028.523898] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 with Priority: HIGHEST for action security_group_members [ 1028.524222] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-57f6caaf-dd2c-4608-8f49-775ef39e3893 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.524352] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.524419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.524650] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.524870] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.525008] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.525276] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.525451] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.525539] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.525639] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57f6caaf-dd2c-4608-8f49-775ef39e3893',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.588102] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.027688] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.027963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.028069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.028340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.028447] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.028666] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.028759] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.028847] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.028994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.029145] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.029274] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 is going to be updated. [ 1029.057905] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.058091] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.058169] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.058375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.058522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.067742] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 in Status: IN_PROGRESS for 2s [ 1029.091210] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.091351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.091499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.091751] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.091904] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.092105] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1029.094043] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e in Status: SUCCESS [ 1029.094151] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.122080] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.122241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.122338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.122573] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.122713] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.138568] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1029.196993] env[65136]: INFO networking_nsxv3.common.synchronization [req-7ce524d5-718b-4871-9aef-197ee575ba1f req-3fe9dc1f-43fe-44c0-a661-a7be24945532 service nova] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_rules [ 1029.197194] env[65136]: INFO networking_nsxv3.common.synchronization [req-7ce524d5-718b-4871-9aef-197ee575ba1f req-3fe9dc1f-43fe-44c0-a661-a7be24945532 service nova] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1029.197332] env[65136]: INFO networking_nsxv3.common.synchronization [req-7ce524d5-718b-4871-9aef-197ee575ba1f req-3fe9dc1f-43fe-44c0-a661-a7be24945532 service nova] Enqueued Resource ID: 41353864-9260-4412-8af2-68cfcc1c3efd with Priority: HIGHEST for action port [ 1029.197861] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_rules [ 1029.197987] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1029.201510] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41353864-9260-4412-8af2-68cfcc1c3efd with Priority: HIGHEST for action port [ 1029.201781] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.201900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.201973] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.202217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.202299] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.204450] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.204450] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.204594] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-41353864-9260-4412-8af2-68cfcc1c3efd taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.204680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41353864-9260-4412-8af2-68cfcc1c3efd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.204742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41353864-9260-4412-8af2-68cfcc1c3efd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.204918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41353864-9260-4412-8af2-68cfcc1c3efd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.204990] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41353864-9260-4412-8af2-68cfcc1c3efd',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.707854] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.707854] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.708875] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41353864-9260-4412-8af2-68cfcc1c3efd with status ACTIVE [ 1029.708875] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.708875] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.708875] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.708875] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.708875] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.709472] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.709472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.709472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.709472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.709472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.709792] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.709792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.709939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.710033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.710119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.710209] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41353864-9260-4412-8af2-68cfcc1c3efd is going to be updated. [ 1029.734123] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.734316] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.734391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.734534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.734672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.734838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41353864-9260-4412-8af2-68cfcc1c3efd" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.081415] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 in Status: SUCCESS [ 1031.081415] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 deletion is rescheduled due to dependency. [ 1031.081652] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.149471] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1031.149471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.150666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.150666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.150666] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.150666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.150666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.150666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.150666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.150666] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.654198] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.156675] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.660265] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.660265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.660265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.660265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.660265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.660265] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1032.690304] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.690436] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.690512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.690718] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.690889] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.701699] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1034.037427] env[65136]: INFO networking_nsxv3.common.synchronization [req-e7329487-6d30-4d7d-b313-d16faa9dcc80 req-524ef37a-ef0b-4486-bbf1-ab4ae8dd3ae2 tempest-DeleteServersTestJSON-1045367082 tempest-DeleteServersTestJSON-1045367082-project-member] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 1034.038097] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 1034.038097] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.038097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.038398] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.038398] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.038554] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.038554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.038850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.038850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.038850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.039103] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.363194] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-186 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.363377] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.363503] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.363794] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.364285] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.364814] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.364814] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.364930] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.365107] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.365422] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.366018] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.366018] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.366018] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.366018] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.366263] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.366263] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.403349] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.403767] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1034.403944] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.404231] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-186" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.404609] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-c3173283-57dd-4322-8dbc-cdf2355155e0 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.404791] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-c3173283-57dd-4322-8dbc-cdf2355155e0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.404913] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-c3173283-57dd-4322-8dbc-cdf2355155e0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.405258] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-c3173283-57dd-4322-8dbc-cdf2355155e0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.405395] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3173283-57dd-4322-8dbc-cdf2355155e0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.542766] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.712299] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1034.712540] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.712714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.712931] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.713138] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.713258] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.713324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.713479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.713563] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.713638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.713738] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.736232] env[65136]: INFO networking_nsxv3.common.synchronization [req-20d25f5e-b0e3-4ce9-ae78-b8fb193c71a9 req-5e588a2d-c70b-4e8f-b6a6-e3ebe8c509e3 tempest-ImagesTestJSON-1051903205 tempest-ImagesTestJSON-1051903205-project-member] Enqueued Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 1034.736950] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 with Priority: HIGHEST for action security_group_members [ 1034.737318] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.738137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.738235] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.738916] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.739144] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.739275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.739754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.739754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.739754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.740083] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.907966] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.908255] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.908385] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.908666] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.908827] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.908999] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port c3173283-57dd-4322-8dbc-cdf2355155e0 not found, creating... [ 1034.909283] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.909441] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.909556] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.909776] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.909937] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.910326] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.910494] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.910609] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.910816] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.911129] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.911300] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: c3173283-57dd-4322-8dbc-cdf2355155e0 is going to be created. [ 1034.932094] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.932417] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.932467] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.933836] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.933836] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.933836] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-c3173283-57dd-4322-8dbc-cdf2355155e0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.045800] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.217924] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.218153] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.218216] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.218479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.218696] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.219183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.219183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.219183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.219183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.219493] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.219493] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.219578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.219614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.219786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.219983] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.220129] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.220209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.220378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.220475] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.220580] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.220705] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.242064] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.242215] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.242276] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.242479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.242972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.242972] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.242972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.242972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.243182] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.243214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.243303] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 is going to be updated. [ 1035.273376] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.273543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.273707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.273827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.273979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.284159] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: IN_PROGRESS for 2s [ 1035.548840] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.549086] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.549136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.549426] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.549564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.549681] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 1035.580500] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.580657] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.580725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.580984] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.581184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.594136] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 1035.664084] env[65136]: INFO networking_nsxv3.common.synchronization [req-e7329487-6d30-4d7d-b313-d16faa9dcc80 req-9fee76e3-ea9b-4185-abca-7b0ec4c778e5 service nova] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_rules [ 1035.664359] env[65136]: INFO networking_nsxv3.common.synchronization [req-e7329487-6d30-4d7d-b313-d16faa9dcc80 req-9fee76e3-ea9b-4185-abca-7b0ec4c778e5 service nova] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 1035.664687] env[65136]: INFO networking_nsxv3.common.synchronization [req-e7329487-6d30-4d7d-b313-d16faa9dcc80 req-9fee76e3-ea9b-4185-abca-7b0ec4c778e5 service nova] Enqueued Resource ID: c3173283-57dd-4322-8dbc-cdf2355155e0 with Priority: HIGHEST for action port [ 1035.665488] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_rules [ 1035.665693] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 1035.665837] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3173283-57dd-4322-8dbc-cdf2355155e0 with Priority: HIGHEST for action port [ 1035.666242] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.666407] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.666500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.666771] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.666883] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.668244] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.668413] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.669033] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3173283-57dd-4322-8dbc-cdf2355155e0 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.669033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3173283-57dd-4322-8dbc-cdf2355155e0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.669033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3173283-57dd-4322-8dbc-cdf2355155e0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.669249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3173283-57dd-4322-8dbc-cdf2355155e0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.669249] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3173283-57dd-4322-8dbc-cdf2355155e0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.722998] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a99f7e35-ad71-4640-a081-3c507e997901: rpc.has_security_group_logging(os_id): False [ 1035.771172] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.771381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.771381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.771617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.771709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.771901] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.772022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.772084] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.772263] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.772339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.772541] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.772637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.772713] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.772857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.772935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.773181] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.773279] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.773355] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.773497] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.773583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.773673] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1035.871575] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.871845] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.871915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.872206] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.872404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.887033] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1036.137110] env[65136]: INFO networking_nsxv3.common.synchronization [None req-259d590b-fff4-429a-b036-8836f993b7d9 tempest-AttachVolumeNegativeTest-40195811 tempest-AttachVolumeNegativeTest-40195811-project-member] Enqueued Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGHEST for action security_group_rules [ 1036.137509] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGHEST for action security_group_rules [ 1036.137765] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7b37bfd-119e-4a70-9b16-a4796e90a688 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.138020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.138380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.138730] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.138853] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7b37bfd-119e-4a70-9b16-a4796e90a688',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.171624] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.171787] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.171912] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3173283-57dd-4322-8dbc-cdf2355155e0 with status ACTIVE [ 1036.172103] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.172226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.172304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.172514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.172601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.172833] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.172919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.172919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.173097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.173175] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.173356] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.173450] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.173512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.173653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.173789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.173824] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3173283-57dd-4322-8dbc-cdf2355155e0 is going to be updated. [ 1036.195187] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.195358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.195401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.195601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.195739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.195903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3173283-57dd-4322-8dbc-cdf2355155e0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.220169] env[65136]: INFO networking_nsxv3.common.synchronization [None req-07de4884-0a1c-431c-9e57-4be3a741c412 tempest-AttachVolumeNegativeTest-40195811 tempest-AttachVolumeNegativeTest-40195811-project-member] Enqueued Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGHEST for action security_group_rules [ 1036.220794] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGHEST for action security_group_rules [ 1036.221370] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7b37bfd-119e-4a70-9b16-a4796e90a688 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.221479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.660942] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.661167] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.661218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.661405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.661494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.661591] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 already deleted. [ 1036.661677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.661832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.662094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.662094] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7b37bfd-119e-4a70-9b16-a4796e90a688',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.196296] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.196296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.196296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.196734] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.196734] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.196734] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 already deleted. [ 1037.196866] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.323995] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 in Status: SUCCESS [ 1037.324210] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15 deletion is rescheduled due to dependency. [ 1037.324305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.604592] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 1037.604784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.604912] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.605154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.605337] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.605453] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.605520] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.605672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.605754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.605843] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.925312] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1037.925533] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.108195] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.610299] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.112702] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.112878] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.112936] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.113190] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.113285] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.114057] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 1039.141315] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.141510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.141637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.141856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.142345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.150989] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 1040.929384] env[65136]: INFO networking_nsxv3.common.synchronization [req-7c0d262c-2615-4882-afef-cd30793cbde8 req-a89c2807-ea1d-4421-8e60-ddd95ec3c0aa tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_members [ 1040.930201] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_members [ 1040.930530] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.930775] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.930775] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.930897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.931199] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.931308] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.931404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.931588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.931683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.931811] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.162641] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 1041.162876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.163068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.163289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.163483] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.163601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.163667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.163821] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.163903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.163989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.164097] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.255033] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-998 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.255033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.255033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.255493] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.255903] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.256721] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.256721] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.256721] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.256721] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.257024] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.257127] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.257218] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.257290] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.257384] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.257490] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.257620] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.279309] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.279553] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1041.279670] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.279815] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.280306] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-ce883baf-28e4-4d25-a5e9-79370b5c8505 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.280509] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-ce883baf-28e4-4d25-a5e9-79370b5c8505" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.280703] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-ce883baf-28e4-4d25-a5e9-79370b5c8505" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.280972] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-ce883baf-28e4-4d25-a5e9-79370b5c8505" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.281231] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce883baf-28e4-4d25-a5e9-79370b5c8505',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.434992] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.666472] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.666679] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.666728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.667089] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.667399] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.667478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.667515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.667664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.667753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.668010] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.668259] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.668381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.668634] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.668804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.669092] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.669237] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.669353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.669478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.669665] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.669665] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.669771] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.784406] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.784615] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.784746] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.785051] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.785209] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.785365] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port ce883baf-28e4-4d25-a5e9-79370b5c8505 not found, creating... [ 1041.785631] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.785788] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.785905] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.786138] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.786322] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.786573] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.786729] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.786847] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.787061] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.787195] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.787332] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: ce883baf-28e4-4d25-a5e9-79370b5c8505 is going to be created. [ 1041.808205] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.808483] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.808575] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.808844] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.809116] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.809362] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-ce883baf-28e4-4d25-a5e9-79370b5c8505" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.937956] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.172588] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5ef8f7d-8350-4fe2-9bef-70ff70b5f141: rpc.has_security_group_logging(os_id): False [ 1042.192969] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.193222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.193303] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.193878] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.193878] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.195038] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.195038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.195038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.195038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.195038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.195298] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.195417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.195458] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.195678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.195796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.196091] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.196234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.196334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.196540] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.196658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.196791] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 1042.274379] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.274489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.274489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.274712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.274933] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.297596] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 1042.441895] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.441895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.441895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.441895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.442226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.442226] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e is going to be updated. [ 1042.482417] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.482417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.482417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.483098] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.483098] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.494030] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e in Status: IN_PROGRESS for 2s [ 1042.560329] env[65136]: INFO networking_nsxv3.common.synchronization [req-7c0d262c-2615-4882-afef-cd30793cbde8 req-145b55a7-b382-4928-8778-039794e6fcb8 service nova] Enqueued Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_rules [ 1042.560643] env[65136]: INFO networking_nsxv3.common.synchronization [req-7c0d262c-2615-4882-afef-cd30793cbde8 req-145b55a7-b382-4928-8778-039794e6fcb8 service nova] Enqueued Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_members [ 1042.560784] env[65136]: INFO networking_nsxv3.common.synchronization [req-7c0d262c-2615-4882-afef-cd30793cbde8 req-145b55a7-b382-4928-8778-039794e6fcb8 service nova] Enqueued Resource ID: ce883baf-28e4-4d25-a5e9-79370b5c8505 with Priority: HIGHEST for action port [ 1042.561336] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_rules [ 1042.561478] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_members [ 1042.561579] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce883baf-28e4-4d25-a5e9-79370b5c8505 with Priority: HIGHEST for action port [ 1042.561862] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.561991] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.562073] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.562319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.562426] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.563528] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.563657] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.563844] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce883baf-28e4-4d25-a5e9-79370b5c8505 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.565630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce883baf-28e4-4d25-a5e9-79370b5c8505" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.565704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce883baf-28e4-4d25-a5e9-79370b5c8505" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.566151] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce883baf-28e4-4d25-a5e9-79370b5c8505" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.566151] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce883baf-28e4-4d25-a5e9-79370b5c8505',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.068120] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.068569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.068569] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce883baf-28e4-4d25-a5e9-79370b5c8505 with status ACTIVE [ 1043.068719] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.068874] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.068948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.069395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.069501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.069678] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.069776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.069841] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.070020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.070156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.070421] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.070595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.070683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.070831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.070995] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.071178] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce883baf-28e4-4d25-a5e9-79370b5c8505 is going to be updated. [ 1043.093826] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.094042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.094042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.094260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.094403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.094589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce883baf-28e4-4d25-a5e9-79370b5c8505" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.316262] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 1044.316745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.511738] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e in Status: SUCCESS [ 1044.511738] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.511738] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.511738] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.511738] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.511738] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.511738] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.511738] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.511738] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.511738] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.015610] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.518040] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.021653] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.021859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.021999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.022280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.022402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.022535] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e is going to be updated. [ 1046.062262] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.062526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.062526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.063204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.063204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.075149] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e in Status: IN_PROGRESS for 2s [ 1047.438147] env[65136]: INFO networking_nsxv3.common.synchronization [None req-57268657-d599-410c-9b71-d54d24473359 None None] Enqueued Resource ID: 8cab22e3-945f-4814-b617-f6b4a09b0793 with Priority: HIGHEST for action port [ 1047.439029] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cab22e3-945f-4814-b617-f6b4a09b0793 with Priority: HIGHEST for action port [ 1047.440714] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-8cab22e3-945f-4814-b617-f6b4a09b0793 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.440714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8cab22e3-945f-4814-b617-f6b4a09b0793" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.440714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8cab22e3-945f-4814-b617-f6b4a09b0793" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.440714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8cab22e3-945f-4814-b617-f6b4a09b0793" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.440714] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8cab22e3-945f-4814-b617-f6b4a09b0793',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.943081] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8cab22e3-945f-4814-b617-f6b4a09b0793 [ 1047.943301] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.943410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.943410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.943769] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.943769] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.943890] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8cab22e3-945f-4814-b617-f6b4a09b0793 already deleted. [ 1047.943890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8cab22e3-945f-4814-b617-f6b4a09b0793" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.091538] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e in Status: SUCCESS [ 1048.091538] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.091538] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.091538] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.091538] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.091538] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.091538] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.091538] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.091538] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.091538] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.091538] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.329269] env[65136]: INFO networking_nsxv3.common.synchronization [req-08ee699e-8f32-40c1-9460-cddd75e32a97 req-95e299bb-921a-48b3-bf55-52baa18df04b tempest-AttachVolumeNegativeTest-40195811 tempest-AttachVolumeNegativeTest-40195811-project-member] Enqueued Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGHEST for action security_group_members [ 1048.329803] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGHEST for action security_group_members [ 1048.330132] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7b37bfd-119e-4a70-9b16-a4796e90a688 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.330320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.330389] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.331315] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.331315] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.331563] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.331563] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.331699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.331793] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.331910] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7b37bfd-119e-4a70-9b16-a4796e90a688',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.338703] env[65136]: INFO networking_nsxv3.common.synchronization [None req-e00996c6-c1a7-407f-adcd-531199c9f5b3 tempest-ServersTestBootFromVolume-1565380015 tempest-ServersTestBootFromVolume-1565380015-project-member] Enqueued Resource ID: a0070031-3f89-4a59-8e86-79ba8d922e5b with Priority: HIGHEST for action security_group_rules [ 1048.339267] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0070031-3f89-4a59-8e86-79ba8d922e5b with Priority: HIGHEST for action security_group_rules [ 1048.339616] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0070031-3f89-4a59-8e86-79ba8d922e5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.339776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.339828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.340045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.340131] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0070031-3f89-4a59-8e86-79ba8d922e5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.458581] env[65136]: INFO networking_nsxv3.common.synchronization [None req-2334c8d9-7095-421c-a3c4-baef5b99069e tempest-ServersTestBootFromVolume-1565380015 tempest-ServersTestBootFromVolume-1565380015-project-member] Enqueued Resource ID: a0070031-3f89-4a59-8e86-79ba8d922e5b with Priority: HIGHEST for action security_group_rules [ 1048.459192] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0070031-3f89-4a59-8e86-79ba8d922e5b with Priority: HIGHEST for action security_group_rules [ 1048.461336] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0070031-3f89-4a59-8e86-79ba8d922e5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.461336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.597909] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.787171] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-525 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.787377] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-525" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.787585] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-525" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.787981] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-525" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.788439] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.788625] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.788747] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.789249] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.790214] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.790214] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.790214] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1048.790214] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1048.790214] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1048.790214] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.790484] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1048.790484] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1048.812642] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1048.812861] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1048.813558] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1048.813558] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-525" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.813963] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-9a78df3a-69be-4ddc-844c-47d12e732773 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.814235] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-9a78df3a-69be-4ddc-844c-47d12e732773" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.814359] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-9a78df3a-69be-4ddc-844c-47d12e732773" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.814940] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-9a78df3a-69be-4ddc-844c-47d12e732773" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.814940] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a78df3a-69be-4ddc-844c-47d12e732773',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.837309] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.837309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.837309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.837309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.837309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.837309] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.837309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.837309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.837309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.837309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.837309] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 already deleted. [ 1048.837309] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.863811] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.863811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.863811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.863811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.864299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.864299] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0070031-3f89-4a59-8e86-79ba8d922e5b already deleted. [ 1048.864299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.864299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.864438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.864438] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0070031-3f89-4a59-8e86-79ba8d922e5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.104808] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb9ff62c-64bb-4ec0-8e08-87a27863a22e: rpc.has_security_group_logging(os_id): False [ 1049.126516] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.126689] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.126753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.126941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.127040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.127291] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.127395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.127461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.127623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.127701] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.127804] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e is going to be updated. [ 1049.187319] env[65136]: INFO networking_nsxv3.common.synchronization [req-fef69626-4d53-4f8c-97aa-3d0302213637 req-678dd9c7-3068-48b4-aa74-cf7ec553af9f tempest-ServerDiskConfigTestJSON-1818502390 tempest-ServerDiskConfigTestJSON-1818502390-project-member] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 1049.188639] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.188783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.188843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.189065] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.189213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.190668] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 1049.191353] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.191471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.191538] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.191706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.191852] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.191948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.192024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.192163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.192244] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.192342] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.205588] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e in Status: IN_PROGRESS for 2s [ 1049.321853] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.321853] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.321853] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.321853] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.321853] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.321853] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 9a78df3a-69be-4ddc-844c-47d12e732773 not found, creating... [ 1049.321853] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.321853] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.321853] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.322411] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.322411] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.322411] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.323229] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.323229] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.323229] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.323229] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.323995] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 9a78df3a-69be-4ddc-844c-47d12e732773 is going to be created. [ 1049.352326] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.352326] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.352326] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.352326] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.352326] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.352326] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-9a78df3a-69be-4ddc-844c-47d12e732773" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.393717] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.393917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.394029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.394288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.394427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.394557] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0070031-3f89-4a59-8e86-79ba8d922e5b already deleted. [ 1049.394739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.695099] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.695446] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.695446] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.695598] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.695705] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.696109] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.696254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.696330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.696509] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.696609] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.696703] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be updated. [ 1049.742796] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.744525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.744525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.744525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.744525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.758964] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 1050.067462] env[65136]: INFO networking_nsxv3.common.synchronization [req-08ee699e-8f32-40c1-9460-cddd75e32a97 req-b7be088f-caea-40ec-956b-5191a6f9c3d7 service nova] Enqueued Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGHEST for action security_group_rules [ 1050.067677] env[65136]: INFO networking_nsxv3.common.synchronization [req-08ee699e-8f32-40c1-9460-cddd75e32a97 req-b7be088f-caea-40ec-956b-5191a6f9c3d7 service nova] Enqueued Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGHEST for action security_group_members [ 1050.067906] env[65136]: INFO networking_nsxv3.common.synchronization [req-08ee699e-8f32-40c1-9460-cddd75e32a97 req-b7be088f-caea-40ec-956b-5191a6f9c3d7 service nova] Enqueued Resource ID: 9a78df3a-69be-4ddc-844c-47d12e732773 with Priority: HIGHEST for action port [ 1050.068489] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGHEST for action security_group_rules [ 1050.068630] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGHEST for action security_group_members [ 1050.068737] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a78df3a-69be-4ddc-844c-47d12e732773 with Priority: HIGHEST for action port [ 1050.069236] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7b37bfd-119e-4a70-9b16-a4796e90a688 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.069236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.069236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.069556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.069556] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7b37bfd-119e-4a70-9b16-a4796e90a688',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.070535] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7b37bfd-119e-4a70-9b16-a4796e90a688 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.070535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.070695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.070803] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.070914] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.071012] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.071116] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.071240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.071314] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.071387] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7b37bfd-119e-4a70-9b16-a4796e90a688',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.072492] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a78df3a-69be-4ddc-844c-47d12e732773 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.072492] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a78df3a-69be-4ddc-844c-47d12e732773" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.072492] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a78df3a-69be-4ddc-844c-47d12e732773" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.072677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a78df3a-69be-4ddc-844c-47d12e732773" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.072677] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a78df3a-69be-4ddc-844c-47d12e732773',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.186942] env[65136]: INFO networking_nsxv3.common.synchronization [None req-1b878982-953a-4e9b-8e99-0c53802271a1 None None] Enqueued Resource ID: ca18803f-2613-4b24-a46f-c9e967df4caa with Priority: HIGHEST for action port [ 1050.187365] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca18803f-2613-4b24-a46f-c9e967df4caa with Priority: HIGHEST for action port [ 1050.187641] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca18803f-2613-4b24-a46f-c9e967df4caa taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.187822] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca18803f-2613-4b24-a46f-c9e967df4caa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.187822] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca18803f-2613-4b24-a46f-c9e967df4caa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.188129] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca18803f-2613-4b24-a46f-c9e967df4caa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.188281] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca18803f-2613-4b24-a46f-c9e967df4caa',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.247193] env[65136]: INFO networking_nsxv3.common.synchronization [req-f4192d81-ce4d-4594-ae58-74c750160dc1 req-e1e0c50b-bc06-42c0-abfb-f9f12bd35c18 tempest-ServersTestJSON-425456513 tempest-ServersTestJSON-425456513-project-member] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1050.247707] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1050.248545] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.248697] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.249187] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.249187] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.249187] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.249362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.249362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.249450] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.249524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.249594] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.574245] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7b37bfd-119e-4a70-9b16-a4796e90a688 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.574393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.574605] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7b37bfd-119e-4a70-9b16-a4796e90a688',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.576842] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a78df3a-69be-4ddc-844c-47d12e732773 with status ACTIVE [ 1050.576842] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.576842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.576842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.576842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.576842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.576842] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.576842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.576842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.576842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.576842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.577893] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.577893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.577893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.577893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.577893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.577893] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a78df3a-69be-4ddc-844c-47d12e732773 is going to be updated. [ 1050.603057] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.603057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.603057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.603057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.603057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.603057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a78df3a-69be-4ddc-844c-47d12e732773" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.606106] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.607726] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.607726] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.607726] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.609308] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.609308] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.609308] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.609308] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.609308] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.609308] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.609308] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1050.609580] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1050.609808] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1050.610057] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.610293] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1050.610535] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1050.632339] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1050.632560] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1050.632648] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1050.632824] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.633236] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-c20fd407-f687-44ea-ab25-1a0dc2fe9823 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.633368] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-c20fd407-f687-44ea-ab25-1a0dc2fe9823" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.633452] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-c20fd407-f687-44ea-ab25-1a0dc2fe9823" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.633787] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-c20fd407-f687-44ea-ab25-1a0dc2fe9823" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.633925] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c20fd407-f687-44ea-ab25-1a0dc2fe9823',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.695564] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca18803f-2613-4b24-a46f-c9e967df4caa [ 1050.695564] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.695564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.695564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.695564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.695564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.695564] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca18803f-2613-4b24-a46f-c9e967df4caa already deleted. [ 1050.695564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca18803f-2613-4b24-a46f-c9e967df4caa" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.752132] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.079248] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7b37bfd-119e-4a70-9b16-a4796e90a688',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.140027] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.140027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.140027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.140027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.140027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.140027] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port c20fd407-f687-44ea-ab25-1a0dc2fe9823 not found, creating... [ 1051.140027] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.140027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.140027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.140027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.140027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.140624] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.140624] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.140624] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.140624] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.140624] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.140624] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: c20fd407-f687-44ea-ab25-1a0dc2fe9823 is going to be created. [ 1051.167024] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.167024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.167024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.167024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.167024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.167024] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-c20fd407-f687-44ea-ab25-1a0dc2fe9823" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.222168] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e in Status: SUCCESS [ 1051.222526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.256365] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.581218] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.581451] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.581541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.581735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.581812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.581911] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 is going to be created. [ 1051.609391] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.609391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.609391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.609391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.609391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.629493] env[65136]: INFO networking_nsxv3.common.synchronization [None req-45439535-349a-4838-ac0a-592ee63474f3 tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 1051.633888] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 1051.634617] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 in Status: UNINITIALIZED for 2s [ 1051.635321] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.635427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.635490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.635694] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.635837] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.635997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.636701] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.636932] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.637047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.637159] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.758989] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.759301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.759301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.759545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.759651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.759795] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1051.771389] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 1051.771590] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d deletion is rescheduled due to dependency. [ 1051.771691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.794290] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.794429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.794499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.794701] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.794836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.805708] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1051.896994] env[65136]: INFO networking_nsxv3.common.synchronization [req-f4192d81-ce4d-4594-ae58-74c750160dc1 req-7edbf264-f202-4ef0-8f9c-1f91b034555f service nova] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_rules [ 1051.897221] env[65136]: INFO networking_nsxv3.common.synchronization [req-f4192d81-ce4d-4594-ae58-74c750160dc1 req-7edbf264-f202-4ef0-8f9c-1f91b034555f service nova] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1051.897424] env[65136]: INFO networking_nsxv3.common.synchronization [req-f4192d81-ce4d-4594-ae58-74c750160dc1 req-7edbf264-f202-4ef0-8f9c-1f91b034555f service nova] Enqueued Resource ID: c20fd407-f687-44ea-ab25-1a0dc2fe9823 with Priority: HIGHEST for action port [ 1051.898085] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_rules [ 1051.898348] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1051.898482] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c20fd407-f687-44ea-ab25-1a0dc2fe9823 with Priority: HIGHEST for action port [ 1051.898805] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.899345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.899345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.899345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.899345] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.900789] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.900789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.900789] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-c20fd407-f687-44ea-ab25-1a0dc2fe9823 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.900789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c20fd407-f687-44ea-ab25-1a0dc2fe9823" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.900789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c20fd407-f687-44ea-ab25-1a0dc2fe9823" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.901054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c20fd407-f687-44ea-ab25-1a0dc2fe9823" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.901054] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c20fd407-f687-44ea-ab25-1a0dc2fe9823',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.141244] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.141244] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.141244] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.141244] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.141244] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.141244] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.141244] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.141244] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.141244] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.141244] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.141761] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be updated. [ 1052.166890] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.167074] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.167147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.167352] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.167488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.177913] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: IN_PROGRESS for 2s [ 1052.404331] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.404651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.404869] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c20fd407-f687-44ea-ab25-1a0dc2fe9823 with status ACTIVE [ 1052.405064] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.405200] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.405308] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.405597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.405714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.405955] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.406151] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.406231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.406416] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.406549] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.406774] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.406934] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.407024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.407269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.407354] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.407431] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c20fd407-f687-44ea-ab25-1a0dc2fe9823 is going to be updated. [ 1052.432582] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.433066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.433066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.433404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.433626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.435214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c20fd407-f687-44ea-ab25-1a0dc2fe9823" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.645118] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 in Status: SUCCESS [ 1053.645504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.645504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.645719] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.645912] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.646039] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.646092] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.646245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.646323] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.646409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.646577] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7b37bfd-119e-4a70-9b16-a4796e90a688',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.816730] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1053.817186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.817186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.817358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.817540] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.817653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.817716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.817862] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.818614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.818614] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.149671] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7b37bfd-119e-4a70-9b16-a4796e90a688',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.190257] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 1054.190257] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde deletion is rescheduled due to dependency. [ 1054.190257] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.320465] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.520502] env[65136]: INFO networking_nsxv3.common.synchronization [req-102fa2fe-f202-4688-8bf6-ac8b0a389296 req-cc1f92ba-4151-4761-9d28-159369da74e3 tempest-ListImageFiltersTestJSON-1546457776 tempest-ListImageFiltersTestJSON-1546457776-project-member] Enqueued Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_members [ 1054.521138] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_members [ 1054.521766] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-40323bed-e172-4548-9cf3-56d3a2a8e71d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.521978] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.522105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.522431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.522688] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.522873] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.522949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.523250] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.523395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.523552] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.652171] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7b37bfd-119e-4a70-9b16-a4796e90a688: rpc.has_security_group_logging(os_id): False [ 1054.669521] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.669818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.669818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.669965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.670040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.670288] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.670524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.670524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.670653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.670737] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.670820] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 is going to be created. [ 1054.730894] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.731155] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.731155] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.731332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.731657] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.742252] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 in Status: IN_PROGRESS for 2s [ 1054.824175] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.027325] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.326580] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.326762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.326865] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.327165] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.327274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.331028] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1055.372070] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.372280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.372370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.372619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.372954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.387664] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1055.530394] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.033816] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.034219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.034219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.034383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.034531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.034645] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d is going to be updated. [ 1056.066767] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.066927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.067019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.067209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.067376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.070897] env[65136]: INFO networking_nsxv3.common.synchronization [req-7ee2c25e-3692-45a8-94cd-deffbe1b3e44 req-b7f65763-7d9f-434e-b577-5403658bcc44 tempest-ServerDiskConfigTestJSON-1818502390 tempest-ServerDiskConfigTestJSON-1818502390-project-member] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 1056.071525] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 1056.071857] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.071980] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.072068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.072218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.072369] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.072466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.072522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.072717] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.072913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.073043] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.079342] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d in Status: IN_PROGRESS for 2s [ 1056.449064] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-200 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.449353] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.449538] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.449823] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.450123] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.450308] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.450463] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.450691] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.450915] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.451095] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.451243] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.451320] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.451485] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.451622] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.451735] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.451936] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.475781] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.475980] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1056.476098] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.476273] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-200" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.476590] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-924f3e14-ceb7-43b0-ae66-11c1679bf3b0 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.476758] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-924f3e14-ceb7-43b0-ae66-11c1679bf3b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.476876] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-924f3e14-ceb7-43b0-ae66-11c1679bf3b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.477280] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-924f3e14-ceb7-43b0-ae66-11c1679bf3b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.477421] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('924f3e14-ceb7-43b0-ae66-11c1679bf3b0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.576319] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.576319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.576319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.576319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.576646] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.576646] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.576736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.576736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.577020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.577020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.577154] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be updated. [ 1056.615137] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.615137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.615137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.615137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.615137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.631344] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 1056.757263] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 in Status: SUCCESS [ 1056.757263] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.980473] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.981107] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.981274] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.981613] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.981904] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.982106] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 924f3e14-ceb7-43b0-ae66-11c1679bf3b0 not found, creating... [ 1056.982396] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.982574] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.982772] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.983265] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.983601] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.983966] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.984482] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.984685] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.984967] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.985577] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.985896] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 924f3e14-ceb7-43b0-ae66-11c1679bf3b0 is going to be created. [ 1057.012343] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.012749] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.012959] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.013370] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.013766] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.014089] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-924f3e14-ceb7-43b0-ae66-11c1679bf3b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.399449] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1057.399819] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.399819] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.400011] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.400217] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.400333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.400472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.400646] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.400727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.400817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.400912] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.742883] env[65136]: INFO networking_nsxv3.common.synchronization [req-7ee2c25e-3692-45a8-94cd-deffbe1b3e44 req-20b8f79d-6450-46f0-9f5e-c5755859e2d2 service nova] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_rules [ 1057.743156] env[65136]: INFO networking_nsxv3.common.synchronization [req-7ee2c25e-3692-45a8-94cd-deffbe1b3e44 req-20b8f79d-6450-46f0-9f5e-c5755859e2d2 service nova] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 1057.743354] env[65136]: INFO networking_nsxv3.common.synchronization [req-7ee2c25e-3692-45a8-94cd-deffbe1b3e44 req-20b8f79d-6450-46f0-9f5e-c5755859e2d2 service nova] Enqueued Resource ID: 924f3e14-ceb7-43b0-ae66-11c1679bf3b0 with Priority: HIGHEST for action port [ 1057.743898] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_rules [ 1057.744119] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 1057.744481] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 924f3e14-ceb7-43b0-ae66-11c1679bf3b0 with Priority: HIGHEST for action port [ 1057.744931] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.745388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.745388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.745388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.745598] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.746689] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.746839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.747025] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-924f3e14-ceb7-43b0-ae66-11c1679bf3b0 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.747127] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-924f3e14-ceb7-43b0-ae66-11c1679bf3b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.747272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-924f3e14-ceb7-43b0-ae66-11c1679bf3b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.747377] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-924f3e14-ceb7-43b0-ae66-11c1679bf3b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.747460] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('924f3e14-ceb7-43b0-ae66-11c1679bf3b0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.903647] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.903922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.904070] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.904531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.904531] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.904783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.904783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.904910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.904910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.905016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.905228] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.905292] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.905333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.905481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.905626] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.905715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.905776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.905911] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.906074] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.906139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.906212] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.090999] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d in Status: SUCCESS [ 1058.091290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.218179] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.218383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.218445] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.218788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.218878] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.250356] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.250615] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.250823] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 924f3e14-ceb7-43b0-ae66-11c1679bf3b0 with status ACTIVE [ 1058.251467] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.251467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.251467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.251778] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.251778] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.251866] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.251922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.251964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.252115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.252192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.252370] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.252465] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.252523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.252718] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.252833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.252947] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 924f3e14-ceb7-43b0-ae66-11c1679bf3b0 is going to be updated. [ 1058.281904] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.282150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.282150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.282328] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.282546] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.282881] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-924f3e14-ceb7-43b0-ae66-11c1679bf3b0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.409077] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a99f7e35-ad71-4640-a081-3c507e997901: rpc.has_security_group_logging(os_id): False [ 1058.430103] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.430298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.430298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.431033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.431033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.431033] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.431263] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.431263] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.432088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.432088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.432088] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.432088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.432088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.432088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.432356] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.432515] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.432591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.432678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.432860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.432980] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.433119] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1058.495500] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.495758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.495758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.495954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.496085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.513039] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1058.640632] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 1058.640815] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d deletion is rescheduled due to dependency. [ 1058.640909] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.641064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.641283] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.641490] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.641682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.641753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.641874] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.641954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.642064] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.721340] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.144682] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.223244] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.647831] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.725281] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1059.725470] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1060.152173] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.152453] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.152453] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.152712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.152855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.153021] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be updated. [ 1060.204610] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.204610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.204610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.205068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.205068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.216839] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 1060.528397] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1060.528397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.704227] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.704658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.704658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.704732] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.719509] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1060.722785] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.723838] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1060.761601] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.761823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.761823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.761994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.774766] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.775271] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1060.775349] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1060.775439] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1060.842066] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.842313] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.842313] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.842500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.843946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.844148] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1060.920136] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.920361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.920361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.920561] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.920949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.921245] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1061.007046] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.007224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.007304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.007513] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.007805] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.008190] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1061.008294] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b4d6bec9-6ca7-4853-ab37-11ad5c3e2917', '2ffd4802-244f-43db-9a7c-a5a1b6672fde', 'a99f7e35-ad71-4640-a081-3c507e997901', '179594e5-59bd-41ce-8082-1aa739538096', '6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b', 'ee57c421-9f97-4726-90f3-a34f9975cc5b', 'cbc78997-cbe5-4eed-9a43-9c7f00c61ec1', 'a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc', 'b5de81c0-7123-460c-83a6-919b0bf8e09a', '341154f1-9b0b-43bc-8e74-163cf220f74c', 'ed7ec91e-a13b-4082-ab28-c92b4852a8c3', '40323bed-e172-4548-9cf3-56d3a2a8e71d', '57f6caaf-dd2c-4608-8f49-775ef39e3893', 'd7b37bfd-119e-4a70-9b16-a4796e90a688', '605661ba-c8c2-4dae-8382-f55a5d1ead5d', '171f535d-ebee-432f-b393-d063259af9b9', '614443cd-8cb8-47ec-8a41-58ab513d082d', 'f5ef8f7d-8350-4fe2-9bef-70ff70b5f141', 'a3377341-8fcc-4f3f-b4b7-a51279fee1e6', '246d2702-c0f1-4486-92fb-beb4b3b1950e', 'c9e25239-cb71-43b7-9bce-b16b700986d4', '0e10abd8-e332-4023-ac76-224c24377bec', 'dbb8b9b9-cf98-4843-a063-345334ac585b', '4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b', 'c713a5b4-d91d-4c9c-8670-3e057521cf54', '2c51c2cd-9219-40af-b979-dfebe3666f2e', '06b0bf22-61b9-4a96-a3f3-ec08a80369b4', '93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5', '988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15', 'ac3eebaf-da3a-488c-83dd-470138abdfc8', '00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e', 'a503f8a3-35c3-4780-8cb3-fb17a0c4a452', 'f599cf2b-60b7-4420-ad22-ed55d836f3a9', 'd5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c', 'bb9ff62c-64bb-4ec0-8e08-87a27863a22e', 'd34f355b-9e16-4e39-9a04-e9b1d96e578e', '5640a309-d0fa-4870-9eee-f2caeb1f4b8d', 'f4f6034d-9ad4-409e-9b4a-d6ffaa597a63', '9a9a81b8-cfea-4cf0-a7c1-6c152505127c', 'ea847179-b3cb-478f-bcdc-0c75dc43c2bc', '9f4dd229-f786-4bea-badc-2a0fea17968f', '6d7f4864-4465-4dbe-9836-f8fba02f451c', 'e076b0f0-4401-42ce-b608-41c3e6db24f9', '4450efc3-afd8-4465-8453-713d205d5684', '39322202-687d-409e-86ef-4870f36135e8', '5a04e899-b185-4f20-8eea-e0edb95feabb'} {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1061.008423] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1061.028410] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.028649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.028649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.028777] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.028862] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.028976] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1061.029081] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1061.029172] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1061.125078] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.125078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.125397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.125397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.126494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.126780] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1061.126886] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1061.126967] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1061.127057] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1061.127157] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1061.127258] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGH for action security_group_rules [ 1061.127356] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGH for action security_group_rules [ 1061.127448] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGH for action security_group_rules [ 1061.127528] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGH for action security_group_rules [ 1061.127611] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGH for action security_group_rules [ 1061.127683] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGH for action security_group_rules [ 1061.127748] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 with Priority: HIGH for action security_group_rules [ 1061.127811] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc with Priority: HIGH for action security_group_rules [ 1061.127873] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGH for action security_group_rules [ 1061.127935] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGH for action security_group_rules [ 1061.127997] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 with Priority: HIGH for action security_group_rules [ 1061.128093] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGH for action security_group_rules [ 1061.128157] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 with Priority: HIGH for action security_group_rules [ 1061.128222] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGH for action security_group_rules [ 1061.128282] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGH for action security_group_rules [ 1061.128344] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGH for action security_group_rules [ 1061.128430] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGH for action security_group_rules [ 1061.128506] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGH for action security_group_rules [ 1061.128579] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 with Priority: HIGH for action security_group_rules [ 1061.128628] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGH for action security_group_rules [ 1061.128721] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.987746] env[65136]: INFO networking_nsxv3.common.synchronization [req-1d867853-638d-476c-8d97-0387231fa7c0 req-c65e8092-4453-496f-b548-85d9165c1c0c tempest-ListImageFiltersTestJSON-1546457776 tempest-ListImageFiltersTestJSON-1546457776-project-member] Enqueued Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_members [ 1061.989251] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGHEST for action security_group_members [ 1061.989251] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 with Priority: HIGH for action security_group_rules [ 1061.989251] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGH for action security_group_rules [ 1061.989251] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 with Priority: HIGH for action security_group_rules [ 1061.989251] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGH for action security_group_rules [ 1061.989675] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e with Priority: HIGH for action security_group_rules [ 1061.990396] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 with Priority: HIGH for action security_group_rules [ 1061.990396] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGH for action security_group_rules [ 1061.990396] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 614443cd-8cb8-47ec-8a41-58ab513d082d with Priority: HIGH for action security_group_rules [ 1061.990396] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGH for action security_group_rules [ 1061.990396] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 171f535d-ebee-432f-b393-d063259af9b9 with Priority: HIGH for action security_group_rules [ 1061.990676] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 with Priority: HIGH for action security_group_rules [ 1061.990676] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d with Priority: HIGH for action security_group_rules [ 1061.990676] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 with Priority: HIGH for action security_group_rules [ 1061.990770] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGH for action security_group_rules [ 1061.990849] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5de81c0-7123-460c-83a6-919b0bf8e09a with Priority: HIGH for action security_group_rules [ 1061.991031] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee57c421-9f97-4726-90f3-a34f9975cc5b with Priority: HIGH for action security_group_rules [ 1061.991177] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc with Priority: HIGH for action security_group_rules [ 1061.991333] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b with Priority: HIGH for action security_group_rules [ 1061.991470] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGH for action security_group_rules [ 1061.991627] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 179594e5-59bd-41ce-8082-1aa739538096 with Priority: HIGH for action security_group_rules [ 1061.992010] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-40323bed-e172-4548-9cf3-56d3a2a8e71d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.992145] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.992235] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.992462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.992658] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.992863] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.992948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.993136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.993234] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.993390] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.995207] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.995348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.995348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.995458] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.995509] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4d6bec9-6ca7-4853-ab37-11ad5c3e2917',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.996340] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.996449] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.996511] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.996659] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.996734] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.997896] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.998949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.998949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.998949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.998949] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbc78997-cbe5-4eed-9a43-9c7f00c61ec1',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.999702] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.999702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.999702] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-246d2702-c0f1-4486-92fb-beb4b3b1950e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.999702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.999939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.999939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.000017] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('246d2702-c0f1-4486-92fb-beb4b3b1950e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.000808] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3377341-8fcc-4f3f-b4b7-a51279fee1e6 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.000930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.000977] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.002126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.002126] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3377341-8fcc-4f3f-b4b7-a51279fee1e6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.002126] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.002126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.005808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.005808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.005808] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.005808] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-614443cd-8cb8-47ec-8a41-58ab513d082d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.005808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.005808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.005808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.005808] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('614443cd-8cb8-47ec-8a41-58ab513d082d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.005808] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7b37bfd-119e-4a70-9b16-a4796e90a688 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.005808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.005808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.005808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.005808] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7b37bfd-119e-4a70-9b16-a4796e90a688',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.005808] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-171f535d-ebee-432f-b393-d063259af9b9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.006599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.006599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.006599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.006599] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('171f535d-ebee-432f-b393-d063259af9b9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.009946] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57f6caaf-dd2c-4608-8f49-775ef39e3893 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.009946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.009946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.009946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.009946] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57f6caaf-dd2c-4608-8f49-775ef39e3893',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.009946] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-40323bed-e172-4548-9cf3-56d3a2a8e71d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.009946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.009946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.009946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.009946] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('40323bed-e172-4548-9cf3-56d3a2a8e71d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.012329] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed7ec91e-a13b-4082-ab28-c92b4852a8c3 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.012329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.012329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.012329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.012329] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed7ec91e-a13b-4082-ab28-c92b4852a8c3',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.012869] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.012986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.013066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.013215] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.013339] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.014107] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b5de81c0-7123-460c-83a6-919b0bf8e09a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.014267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.014267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.015294] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.016059] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b5de81c0-7123-460c-83a6-919b0bf8e09a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.016316] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee57c421-9f97-4726-90f3-a34f9975cc5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.016376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.016542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.016592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.016905] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee57c421-9f97-4726-90f3-a34f9975cc5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.017322] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.017420] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.017484] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.017903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.018022] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.019531] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.019637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.019743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.019883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.019969] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.020864] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.020972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.021049] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.021216] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.021289] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.022180] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-179594e5-59bd-41ce-8082-1aa739538096 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.023433] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.023524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.023676] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.024184] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('179594e5-59bd-41ce-8082-1aa739538096',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.030804] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.030880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.030918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.031140] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.056344] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.056344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.056856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.057148] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.057269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.057337] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.058076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.058076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.058076] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d is going to be updated. [ 1062.059038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.059038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.061367] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.061367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.081624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.081777] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3377341-8fcc-4f3f-b4b7-a51279fee1e6 is going to be deleted. [ 1062.084986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.084986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.097848] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.098060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.098060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.098262] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.098451] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.109295] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d in Status: IN_PROGRESS for 2s [ 1062.128617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.128617] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4d6bec9-6ca7-4853-ab37-11ad5c3e2917 is going to be deleted. [ 1062.182989] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.183218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.183328] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.183565] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.183664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.183788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3377341-8fcc-4f3f-b4b7-a51279fee1e6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.231670] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 1062.232060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.232146] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.232356] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.232555] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.232701] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.232797] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.232979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.233069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.233151] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.233243] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.234932] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.235123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.235123] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.235382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.235382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.235525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4d6bec9-6ca7-4853-ab37-11ad5c3e2917" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.531024] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.531024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.531024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.531024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.531024] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.535773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.535773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.535773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.535773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.535773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.535773] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.535773] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7b37bfd-119e-4a70-9b16-a4796e90a688 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.535773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.535773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.535773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.535773] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.535773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.535773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.535773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.535773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.535773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.535773] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7b37bfd-119e-4a70-9b16-a4796e90a688',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.540265] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.540265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.540265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.540265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.540265] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.540265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.540265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.540265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.540265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.540265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.540697] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.543076] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.543076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.543076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.543076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.543076] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.543076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.543076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.545301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.545301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.545301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.545301] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.586883] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.587109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.587159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.587431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.607558] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.607806] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.609137] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.609256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.610296] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.610397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.611835] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.612295] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.612735] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.612828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.613627] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.613760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.614768] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.614903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.615923] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.616072] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.616899] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.616992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.617902] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.618081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.619016] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1062.619606] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.619742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.626375] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1062.626375] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.626375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.628795] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1062.629074] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.629233] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc is going to be deleted. [ 1062.630987] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.630987] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.654685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.654685] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be deleted. [ 1062.655427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.655518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.676017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.676196] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 171f535d-ebee-432f-b393-d063259af9b9 is going to be deleted. [ 1062.677171] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.677393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.696951] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.697201] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.699576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.699702] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 246d2702-c0f1-4486-92fb-beb4b3b1950e is going to be deleted. [ 1062.700640] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.700849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.710085] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.710272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.727960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.728239] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b is going to be deleted. [ 1062.729257] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.729502] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.736767] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.737018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.737156] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.737482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.737748] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.737923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.738049] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.738303] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.738460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.738716] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.738899] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.739079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.739204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.739443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.739679] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.739844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.739968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.740220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.740367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.740540] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.740691] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.763528] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.763856] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 179594e5-59bd-41ce-8082-1aa739538096 is going to be deleted. [ 1062.765550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.765550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.808708] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.808708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.811746] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.811746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.849967] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.850426] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee57c421-9f97-4726-90f3-a34f9975cc5b is going to be deleted. [ 1062.851880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.852129] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.852221] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.852318] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d is going to be deleted. [ 1062.853317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.853496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.888097] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.888097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.909681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.909795] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57f6caaf-dd2c-4608-8f49-775ef39e3893 is going to be deleted. [ 1062.911172] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.911470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.052701] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.053557] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7b37bfd-119e-4a70-9b16-a4796e90a688',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.054344] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.054344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.054344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.054625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.054625] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.055182] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.055182] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.055949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.055949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.055949] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.056211] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.057184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.057184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.057184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.057184] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.057184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.057184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.057524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.057698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.057746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.059712] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.059712] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.059712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.059712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.059712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.059712] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.059712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.059712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.060642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.060642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.060642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.060642] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.060642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.060642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.061034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.061175] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.061317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.061419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.061624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.061792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.061921] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.062086] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.134080] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.134311] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 614443cd-8cb8-47ec-8a41-58ab513d082d is going to be deleted. [ 1063.135560] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.136021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.138573] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.138760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.172098] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.172353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.184287] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.184517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.214439] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.214621] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbc78997-cbe5-4eed-9a43-9c7f00c61ec1 is going to be deleted. [ 1063.215575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.215796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.230330] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.230478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.243990] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605661ba-c8c2-4dae-8382-f55a5d1ead5d: rpc.has_security_group_logging(os_id): False [ 1063.314896] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.314896] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.333916] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.334104] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed7ec91e-a13b-4082-ab28-c92b4852a8c3 is going to be deleted. [ 1063.335105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.335333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.427935] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.428190] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.444330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.444421] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b5de81c0-7123-460c-83a6-919b0bf8e09a is going to be deleted. [ 1063.445356] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.445592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.445674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.445798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a76055e0-3cc2-44eb-8a4c-d15c88ee0ccc" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.445964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.446143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.446251] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.446330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.447089] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.447340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.447470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.447575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-246d2702-c0f1-4486-92fb-beb4b3b1950e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.447889] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.448018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.448106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.448242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-171f535d-ebee-432f-b393-d063259af9b9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.448355] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.448619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.448783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.448783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d0d7dbb-dfe4-44b3-abd6-4395d570ad8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.448952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.449061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.449138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.449277] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-179594e5-59bd-41ce-8082-1aa739538096" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.449444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.449504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.449651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.449787] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.449874] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.450028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.450113] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.450224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee57c421-9f97-4726-90f3-a34f9975cc5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.450348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.450682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.450757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.450872] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57f6caaf-dd2c-4608-8f49-775ef39e3893" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.450998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.451154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.522181] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.522438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.532351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.532619] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.532752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.532831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.533511] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.533511] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.533511] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.533511] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.533511] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.533827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.533827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.533980] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.533980] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.533980] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.534153] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.534210] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.534291] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be updated. [ 1063.535518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.535690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.535862] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.535862] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-614443cd-8cb8-47ec-8a41-58ab513d082d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.536069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.536150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.536353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.536353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbc78997-cbe5-4eed-9a43-9c7f00c61ec1" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.555389] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 341154f1-9b0b-43bc-8e74-163cf220f74c: rpc.has_security_group_logging(os_id): False [ 1063.560776] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7b37bfd-119e-4a70-9b16-a4796e90a688: rpc.has_security_group_logging(os_id): False [ 1063.563490] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5ef8f7d-8350-4fe2-9bef-70ff70b5f141: rpc.has_security_group_logging(os_id): False [ 1063.565617] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.565823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.565823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.566020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.566122] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.566238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b5de81c0-7123-460c-83a6-919b0bf8e09a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.566465] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a99f7e35-ad71-4640-a081-3c507e997901: rpc.has_security_group_logging(os_id): False [ 1063.647212] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.647212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.647423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.647504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.649515] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.649747] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.651748] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.652077] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.653429] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.653705] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.661067] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.661306] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.706638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.706960] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.707109] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.707187] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.707390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.707467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.707572] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 is going to be updated. [ 1063.708804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.708995] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.777968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.778348] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.778512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.778625] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.778886] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.778980] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.779341] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.779678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.779678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.779935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.779935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.780179] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.780264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.780364] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.780586] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.780674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.780748] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 1063.781940] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.782526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.808118] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.808329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.813844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.814267] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.814396] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.814779] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.816038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.816038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.816038] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.816264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.816264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.816375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.816433] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.817178] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.817178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.817178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.817178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.817178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.817575] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1063.819095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.819095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.879537] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.879790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.880684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.881056] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.881178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.881260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.881531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.881620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.881753] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c is going to be updated. [ 1063.883018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.883252] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.883416] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.884506] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.884730] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.884816] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.884964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed7ec91e-a13b-4082-ab28-c92b4852a8c3" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.885215] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.885402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.885629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.917085] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 in Status: IN_PROGRESS for 2s [ 1063.939794] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 1063.956357] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.956601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.956601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.956836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.957020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.988555] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 1064.030117] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.030310] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.030497] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.030630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.030827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.047437] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.047655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.047655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.047898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.048067] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.064203] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: IN_PROGRESS for 2s [ 1064.068709] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1064.135046] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d in Status: SUCCESS [ 1064.135272] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 40323bed-e172-4548-9cf3-56d3a2a8e71d deletion is rescheduled due to dependency. [ 1064.135428] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-40323bed-e172-4548-9cf3-56d3a2a8e71d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.503055] env[65136]: INFO networking_nsxv3.common.synchronization [req-bdbf5e17-19cb-498c-a95f-815f276f0edb req-e4f2f774-9658-4cd4-be54-c936165f1564 tempest-ServersTestJSON-425456513 tempest-ServersTestJSON-425456513-project-member] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1064.503055] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1064.503500] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.503589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.503589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.503833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.504199] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.504199] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.504326] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.504438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.504570] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.504727] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.864690] env[65136]: INFO networking_nsxv3.common.synchronization [req-56a3afb0-27f5-4a17-b308-1366ec7c4be3 req-6d93604c-eb81-41c6-b825-9b2b92630a4c tempest-ServerActionsTestJSON-513195432 tempest-ServerActionsTestJSON-513195432-project-member] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 1064.865586] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 1064.866019] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.866464] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.866534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.866751] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.866908] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.867021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.867095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.867376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.867465] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.867565] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.006833] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.369882] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.370305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.370305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.370408] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.370443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.370772] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.370881] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.370983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.371289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.371417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.371492] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c is going to be updated. [ 1065.402430] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.402630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.402630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.402884] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.403089] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.413914] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: IN_PROGRESS for 2s [ 1065.508542] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.933950] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 in Status: SUCCESS [ 1065.934261] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.953276] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 1065.953591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.953677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.953902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.953995] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.005512] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 1066.005769] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.010760] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.010972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.010972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.011197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.011286] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.011382] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1066.043040] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.043233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.043339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.043575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.043754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.053777] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1066.081125] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: SUCCESS [ 1066.081297] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.082254] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1066.082438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.456801] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.456801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.456801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.457434] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.457434] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.457434] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.457434] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.457619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.457619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.457682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.457769] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.960276] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.960484] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.960605] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.960879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.961124] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.961238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.961304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.961462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.961551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.961705] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.961803] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.961868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.961950] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.962075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.962210] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.962801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.962801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.962801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.962801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.962801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.962801] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.425346] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: SUCCESS [ 1067.425572] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c deletion is rescheduled due to dependency. [ 1067.425629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.465309] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 605661ba-c8c2-4dae-8382-f55a5d1ead5d: rpc.has_security_group_logging(os_id): False [ 1067.520532] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.520532] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.520532] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.520708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.521148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.521352] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.521522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.521904] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.521904] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.522105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.522323] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.522429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.522493] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.522690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.522743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.523027] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.523212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.523329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.523553] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.523670] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.523771] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be updated. [ 1067.589745] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.589898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.589972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.590191] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.590338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.603968] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 1068.066373] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1068.066663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.621440] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 1069.621806] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.625908] env[65136]: INFO networking_nsxv3.common.synchronization [req-7453d93e-1d6d-4da9-8c43-7ad1be4b6a7d req-a7402bf6-dc0e-4c59-bd18-c52357e36c81 tempest-ServerDiskConfigTestJSON-1818502390 tempest-ServerDiskConfigTestJSON-1818502390-project-member] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 1069.625975] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGHEST for action security_group_members [ 1069.626294] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.626433] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.626508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.626722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.626877] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.627233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.627233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.627233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.627472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.627472] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.816057] env[65136]: INFO networking_nsxv3.common.synchronization [None req-fa019ac2-d27b-4f6f-a629-252f7876bf8a None None] Enqueued Resource ID: 92542c47-6b79-44d4-a790-f1beaad85d22 with Priority: HIGHEST for action port [ 1069.817385] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92542c47-6b79-44d4-a790-f1beaad85d22 with Priority: HIGHEST for action port [ 1069.817606] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-92542c47-6b79-44d4-a790-f1beaad85d22 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.817744] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92542c47-6b79-44d4-a790-f1beaad85d22" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.817814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92542c47-6b79-44d4-a790-f1beaad85d22" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.818092] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92542c47-6b79-44d4-a790-f1beaad85d22" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.818179] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92542c47-6b79-44d4-a790-f1beaad85d22',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.129995] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.130186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.130260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.130465] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.130557] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.130772] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.130879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.130943] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.131147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.131226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.131313] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be updated. [ 1070.161230] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.162672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.162763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.163273] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.163273] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.173274] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: IN_PROGRESS for 2s [ 1070.322038] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92542c47-6b79-44d4-a790-f1beaad85d22 [ 1070.323028] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.323028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.323028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.323028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.323028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.323028] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92542c47-6b79-44d4-a790-f1beaad85d22 already deleted. [ 1070.323028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92542c47-6b79-44d4-a790-f1beaad85d22" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.522660] env[65136]: INFO networking_nsxv3.common.synchronization [None req-d16f1f87-0911-462a-ac5b-fc8681b3b942 tempest-ServersTestManualDisk-933515256 tempest-ServersTestManualDisk-933515256-project-member] Enqueued Resource ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b with Priority: HIGHEST for action security_group_rules [ 1070.524389] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b with Priority: HIGHEST for action security_group_rules [ 1070.524843] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-627dff8d-ead1-4820-9473-3d8056d3cd8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.525505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.525505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.526402] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.526402] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('627dff8d-ead1-4820-9473-3d8056d3cd8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.636983] env[65136]: INFO networking_nsxv3.common.synchronization [None req-12cb70d1-f383-4f7a-864b-14d8ee423d26 tempest-ServersTestManualDisk-933515256 tempest-ServersTestManualDisk-933515256-project-member] Enqueued Resource ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b with Priority: HIGHEST for action security_group_rules [ 1070.637621] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b with Priority: HIGHEST for action security_group_rules [ 1070.637943] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-627dff8d-ead1-4820-9473-3d8056d3cd8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.638301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.794674] env[65136]: INFO networking_nsxv3.common.synchronization [req-1922bee6-2650-46a7-a229-29e723c9256e req-2f112a0a-8956-416d-aeec-256996b77b96 tempest-AttachVolumeTestJSON-333791645 tempest-AttachVolumeTestJSON-333791645-project-member] Enqueued Resource ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c with Priority: HIGHEST for action security_group_members [ 1070.794674] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c with Priority: HIGHEST for action security_group_members [ 1070.795107] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.795267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.795357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.795580] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.795765] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.795955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.796060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.796239] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.796351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.796469] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a9a81b8-cfea-4cf0-a7c1-6c152505127c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.050658] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.050963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.051081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.051386] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.051470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.051504] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b already deleted. [ 1071.051584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.051737] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.051894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.051977] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('627dff8d-ead1-4820-9473-3d8056d3cd8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.299976] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.299976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.300120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.301918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.302730] env[65136]: INFO networking_nsxv3.common.synchronization [req-9acd71bd-b15a-4b67-8f4d-cce5c05226d5 req-1225945a-ef36-42df-af09-714c668f90ec tempest-ServersTestJSON-425456513 tempest-ServersTestJSON-425456513-project-member] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1071.303430] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1071.304181] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.304325] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.304393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.304617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.304887] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.305066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.305066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.305176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.305315] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.305380] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.331311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.331956] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.331956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.331956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.332202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.332202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.332277] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c is going to be updated. [ 1071.362805] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.362945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.363021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.363263] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.363403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.377263] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c in Status: IN_PROGRESS for 2s [ 1071.582323] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.582558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.583465] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.583537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.583636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.583737] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b already deleted. [ 1071.583824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.807858] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.177866] env[65136]: INFO networking_nsxv3.common.synchronization [None req-43d6e05e-e4da-4658-aa15-c7b18d158568 None None] Enqueued Resource ID: 1cb69b33-4cea-4196-9fee-6fdec0670a9d with Priority: HIGHEST for action port [ 1072.178109] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb69b33-4cea-4196-9fee-6fdec0670a9d with Priority: HIGHEST for action port [ 1072.178494] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cb69b33-4cea-4196-9fee-6fdec0670a9d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.178607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cb69b33-4cea-4196-9fee-6fdec0670a9d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.178830] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cb69b33-4cea-4196-9fee-6fdec0670a9d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.178947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cb69b33-4cea-4196-9fee-6fdec0670a9d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.179019] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cb69b33-4cea-4196-9fee-6fdec0670a9d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.187211] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d in Status: SUCCESS [ 1072.187404] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d deletion is rescheduled due to dependency. [ 1072.187494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.312710] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.681090] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1cb69b33-4cea-4196-9fee-6fdec0670a9d [ 1072.681319] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.681450] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.681519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.681761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.681880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.681983] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1cb69b33-4cea-4196-9fee-6fdec0670a9d already deleted. [ 1072.682084] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cb69b33-4cea-4196-9fee-6fdec0670a9d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.817552] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.817937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.817991] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.818236] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.818383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.818537] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1072.850043] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.850043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.850043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.850043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.850043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.860026] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1073.387204] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c in Status: SUCCESS [ 1073.387276] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a9a81b8-cfea-4cf0-a7c1-6c152505127c deletion is rescheduled due to dependency. [ 1073.387408] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a9a81b8-cfea-4cf0-a7c1-6c152505127c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.963033] env[65136]: INFO networking_nsxv3.common.synchronization [req-fd813677-ac81-4ab2-ac1c-ad10569bf29c req-c0fc3070-644b-4004-ae2c-d87f24d5db6f tempest-ServersTestBootFromVolume-1565380015 tempest-ServersTestBootFromVolume-1565380015-project-member] Enqueued Resource ID: a0070031-3f89-4a59-8e86-79ba8d922e5b with Priority: HIGHEST for action security_group_members [ 1073.963033] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0070031-3f89-4a59-8e86-79ba8d922e5b with Priority: HIGHEST for action security_group_members [ 1073.963033] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0070031-3f89-4a59-8e86-79ba8d922e5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.963033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.963033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.963033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.963033] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.963033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.963033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.963033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.963033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.963033] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0070031-3f89-4a59-8e86-79ba8d922e5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.275298] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-455 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.275505] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-455" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.275631] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-455" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.275977] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-455" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.276261] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.276419] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.276535] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.276744] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.276887] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.277113] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.277226] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.277332] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.277498] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.277669] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.277802] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.277940] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.297868] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.298056] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1074.298193] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.298395] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-455" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.298733] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-383f6058-f5ce-42ee-992c-07b35699b386 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.298954] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-383f6058-f5ce-42ee-992c-07b35699b386" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.299088] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-383f6058-f5ce-42ee-992c-07b35699b386" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.299430] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-383f6058-f5ce-42ee-992c-07b35699b386" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.299568] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('383f6058-f5ce-42ee-992c-07b35699b386',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.463846] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.463846] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.463846] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.463846] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.463846] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.464401] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.464401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.464401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.464401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.464401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.464401] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0070031-3f89-4a59-8e86-79ba8d922e5b already deleted. [ 1074.464666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.802083] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.802326] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.802781] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.802781] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.802868] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.803020] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 383f6058-f5ce-42ee-992c-07b35699b386 not found, creating... [ 1074.803298] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.803459] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.803576] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.803815] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.804436] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.804436] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.804436] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.804654] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.804734] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.804877] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.805163] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 383f6058-f5ce-42ee-992c-07b35699b386 is going to be created. [ 1074.825498] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.825808] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.825959] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.826280] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.826541] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.826793] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-383f6058-f5ce-42ee-992c-07b35699b386" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.870513] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1074.870758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.927943] env[65136]: INFO networking_nsxv3.common.synchronization [req-6105cf27-6ec5-4cf7-819a-097331a0f604 req-fa7bedfe-6999-4e88-a0d2-87114fcd6b43 tempest-ServersTestFqdnHostnames-669601993 tempest-ServersTestFqdnHostnames-669601993-project-member] Enqueued Resource ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 with Priority: HIGHEST for action security_group_members [ 1074.928602] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 with Priority: HIGHEST for action security_group_members [ 1074.929032] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.929230] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.929230] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.930351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.930351] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.930351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.930351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.930351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.930351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.930351] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4f6034d-9ad4-409e-9b4a-d6ffaa597a63',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.433222] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.433222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.433740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.433740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.455307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.455576] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.455694] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.455762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.455986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.456127] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.456220] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 is going to be updated. [ 1075.489162] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.489394] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.489394] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.490207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.490207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.501339] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 in Status: IN_PROGRESS for 2s [ 1075.613180] env[65136]: INFO networking_nsxv3.common.synchronization [req-fd813677-ac81-4ab2-ac1c-ad10569bf29c req-d72aa5fd-0064-4776-9d65-41759764d518 service nova] Enqueued Resource ID: a0070031-3f89-4a59-8e86-79ba8d922e5b with Priority: HIGHEST for action security_group_rules [ 1075.613180] env[65136]: INFO networking_nsxv3.common.synchronization [req-fd813677-ac81-4ab2-ac1c-ad10569bf29c req-d72aa5fd-0064-4776-9d65-41759764d518 service nova] Enqueued Resource ID: a0070031-3f89-4a59-8e86-79ba8d922e5b with Priority: HIGHEST for action security_group_members [ 1075.613180] env[65136]: INFO networking_nsxv3.common.synchronization [req-fd813677-ac81-4ab2-ac1c-ad10569bf29c req-d72aa5fd-0064-4776-9d65-41759764d518 service nova] Enqueued Resource ID: 383f6058-f5ce-42ee-992c-07b35699b386 with Priority: HIGHEST for action port [ 1075.613468] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0070031-3f89-4a59-8e86-79ba8d922e5b with Priority: HIGHEST for action security_group_rules [ 1075.613603] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0070031-3f89-4a59-8e86-79ba8d922e5b with Priority: HIGHEST for action security_group_members [ 1075.613698] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 383f6058-f5ce-42ee-992c-07b35699b386 with Priority: HIGHEST for action port [ 1075.613964] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0070031-3f89-4a59-8e86-79ba8d922e5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.614542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.614647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.615378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.615378] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0070031-3f89-4a59-8e86-79ba8d922e5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.616793] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0070031-3f89-4a59-8e86-79ba8d922e5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.617043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.617139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.618504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.618504] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.618504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.618504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.618504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.618504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.618776] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0070031-3f89-4a59-8e86-79ba8d922e5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.622825] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-383f6058-f5ce-42ee-992c-07b35699b386 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.622825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-383f6058-f5ce-42ee-992c-07b35699b386" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.622825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-383f6058-f5ce-42ee-992c-07b35699b386" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.622825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-383f6058-f5ce-42ee-992c-07b35699b386" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.622825] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('383f6058-f5ce-42ee-992c-07b35699b386',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.122310] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0070031-3f89-4a59-8e86-79ba8d922e5b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.122463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.123832] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 383f6058-f5ce-42ee-992c-07b35699b386 with status ACTIVE [ 1076.124045] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.124174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.124243] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.124453] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.124575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.124704] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.124798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.124863] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.124992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.125134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.125278] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.125347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.125391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.125521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.125594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.125675] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 383f6058-f5ce-42ee-992c-07b35699b386 is going to be updated. [ 1076.126948] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0070031-3f89-4a59-8e86-79ba8d922e5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.152229] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.152390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.152479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.152706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.152873] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.153093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-383f6058-f5ce-42ee-992c-07b35699b386" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.628958] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0070031-3f89-4a59-8e86-79ba8d922e5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.824541] env[65136]: INFO networking_nsxv3.common.synchronization [req-5d8b6ad0-461a-4858-a29c-9b8219b054b7 req-67449c18-624d-4ec4-b385-76bd612c02f9 tempest-ServerRescueNegativeTestJSON-1746403212 tempest-ServerRescueNegativeTestJSON-1746403212-project-member] Enqueued Resource ID: 0e10abd8-e332-4023-ac76-224c24377bec with Priority: HIGHEST for action security_group_members [ 1076.825096] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e10abd8-e332-4023-ac76-224c24377bec with Priority: HIGHEST for action security_group_members [ 1076.825411] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e10abd8-e332-4023-ac76-224c24377bec taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.825544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.825627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.825783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.826120] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.826120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.826120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.826274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.826310] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.826417] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e10abd8-e332-4023-ac76-224c24377bec',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.131375] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.131567] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.131630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.131859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.131983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.132099] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0070031-3f89-4a59-8e86-79ba8d922e5b is going to be created. [ 1077.163636] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.163789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.163907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.164097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.164262] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.176425] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0070031-3f89-4a59-8e86-79ba8d922e5b in Status: UNINITIALIZED for 2s [ 1077.330260] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.330260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.330260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.330260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.356393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.356904] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.357249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.357440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.357827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.358034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.358238] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e10abd8-e332-4023-ac76-224c24377bec is going to be updated. [ 1077.403988] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.403988] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.403988] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.404186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.405027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.418395] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e10abd8-e332-4023-ac76-224c24377bec in Status: IN_PROGRESS for 2s [ 1077.513058] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 in Status: SUCCESS [ 1077.513318] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4f6034d-9ad4-409e-9b4a-d6ffaa597a63 deletion is rescheduled due to dependency. [ 1077.513471] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4f6034d-9ad4-409e-9b4a-d6ffaa597a63" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.187980] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0070031-3f89-4a59-8e86-79ba8d922e5b in Status: SUCCESS [ 1079.188351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.188428] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.188656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.189894] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.189894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.189894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.189894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.189894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.189894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.189894] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0070031-3f89-4a59-8e86-79ba8d922e5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.429336] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e10abd8-e332-4023-ac76-224c24377bec in Status: SUCCESS [ 1079.429509] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e10abd8-e332-4023-ac76-224c24377bec deletion is rescheduled due to dependency. [ 1079.429601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.692562] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0070031-3f89-4a59-8e86-79ba8d922e5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.195978] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0070031-3f89-4a59-8e86-79ba8d922e5b: rpc.has_security_group_logging(os_id): False [ 1080.214578] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.214677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.214677] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.214893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.214979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.215230] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.215326] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.215390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.215530] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.215606] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.215691] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0070031-3f89-4a59-8e86-79ba8d922e5b is going to be created. [ 1080.282842] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.283076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.283158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.283339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.283525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.294083] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0070031-3f89-4a59-8e86-79ba8d922e5b in Status: IN_PROGRESS for 2s [ 1080.932849] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-998 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.933068] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.933197] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.933474] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.933716] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.933868] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.933983] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.934203] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.934341] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.934550] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1080.934663] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1080.934768] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1080.934873] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1080.934982] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1080.935102] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1080.935229] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1080.954089] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1080.954254] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1080.954391] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1080.954560] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.954857] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-aa5c6b1d-2c99-4be1-af36-f6132e683e65 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.955036] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.955158] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.955461] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.955597] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa5c6b1d-2c99-4be1-af36-f6132e683e65',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.458539] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.458539] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.458946] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.459071] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.459352] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.459486] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port aa5c6b1d-2c99-4be1-af36-f6132e683e65 not found, creating... [ 1081.459764] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.459934] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.460070] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.460334] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.460474] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.460781] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.460941] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.461126] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.461382] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.461547] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.461698] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: aa5c6b1d-2c99-4be1-af36-f6132e683e65 is going to be created. [ 1081.483074] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.483310] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.483965] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.483965] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.483965] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.484202] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.826187] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1081.826397] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1082.193718] env[65136]: INFO networking_nsxv3.common.synchronization [req-7f54264c-0c38-4a52-b1e8-14bcf6ecc87e req-3a7ba2e7-8f9d-47a4-bb1e-fc361e11f474 service nova] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_rules [ 1082.193718] env[65136]: INFO networking_nsxv3.common.synchronization [req-7f54264c-0c38-4a52-b1e8-14bcf6ecc87e req-3a7ba2e7-8f9d-47a4-bb1e-fc361e11f474 service nova] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 1082.193803] env[65136]: INFO networking_nsxv3.common.synchronization [req-7f54264c-0c38-4a52-b1e8-14bcf6ecc87e req-3a7ba2e7-8f9d-47a4-bb1e-fc361e11f474 service nova] Enqueued Resource ID: aa5c6b1d-2c99-4be1-af36-f6132e683e65 with Priority: HIGHEST for action port [ 1082.194289] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_rules [ 1082.194429] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 1082.194528] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5c6b1d-2c99-4be1-af36-f6132e683e65 with Priority: HIGHEST for action port [ 1082.196708] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.196846] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.196910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.197176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.197265] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.198229] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.198361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.198429] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.198602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.198751] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.198850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.198923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.199119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.199213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.199306] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.200095] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa5c6b1d-2c99-4be1-af36-f6132e683e65 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.200204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.200267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.200417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.200493] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa5c6b1d-2c99-4be1-af36-f6132e683e65',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.340861] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0070031-3f89-4a59-8e86-79ba8d922e5b in Status: SUCCESS [ 1082.341207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.703543] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.703884] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.703884] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.704806] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa5c6b1d-2c99-4be1-af36-f6132e683e65 with status ACTIVE [ 1082.704994] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.705120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.705356] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.705427] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.705479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.705658] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.705753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.705814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.705959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.706045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.706225] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.706341] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.706388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.706504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.706600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.706650] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa5c6b1d-2c99-4be1-af36-f6132e683e65 is going to be updated. [ 1082.729158] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.729361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.729361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.729560] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.729696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.729852] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.791648] env[65136]: INFO networking_nsxv3.common.synchronization [req-ecee7e81-3cc2-4f07-bbb3-f0b8984834e4 req-d04d0c0a-cdeb-43c5-9b06-244a7610c58e tempest-ServerActionsTestJSON-513195432 tempest-ServerActionsTestJSON-513195432-project-member] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 1082.792222] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 1082.792526] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.792648] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.792715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.792911] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.793088] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.793186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.793248] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.793395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.793480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.793575] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.096674] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-360 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.096935] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.097132] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.097437] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.097737] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.097954] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.098134] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.098389] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.098547] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.098771] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.098934] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.098994] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.099125] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.099238] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.099345] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.099478] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.119013] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.119271] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1083.119335] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.119508] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.119828] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-0a45705b-eef9-4269-b3bb-a0a606bad56f taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.119999] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-0a45705b-eef9-4269-b3bb-a0a606bad56f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.120146] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-0a45705b-eef9-4269-b3bb-a0a606bad56f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.120533] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-0a45705b-eef9-4269-b3bb-a0a606bad56f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.120676] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a45705b-eef9-4269-b3bb-a0a606bad56f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.208719] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.295950] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.296184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.296267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.296492] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.296584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.296876] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.296998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.297078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.297242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.297322] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.297414] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c is going to be updated. [ 1083.327996] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.328165] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.328230] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.328441] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.328584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.337225] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: IN_PROGRESS for 2s [ 1083.624086] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.624086] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.624366] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.624514] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.624697] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.624883] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 0a45705b-eef9-4269-b3bb-a0a606bad56f not found, creating... [ 1083.625209] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.625389] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.625532] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.625825] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.625954] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.626306] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.626493] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.626641] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.626888] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.627067] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.627242] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 0a45705b-eef9-4269-b3bb-a0a606bad56f is going to be created. [ 1083.649523] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.649818] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.649886] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.650198] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.650433] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.650667] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-0a45705b-eef9-4269-b3bb-a0a606bad56f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.711622] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.711968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.711968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.712448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.712448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.712448] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be updated. [ 1083.755165] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.755316] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.755390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.755608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.755751] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.765584] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: IN_PROGRESS for 2s [ 1084.333895] env[65136]: INFO networking_nsxv3.common.synchronization [req-ecee7e81-3cc2-4f07-bbb3-f0b8984834e4 req-b682ac2c-b043-427b-9996-a92d30cd0e69 service nova] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_rules [ 1084.334100] env[65136]: INFO networking_nsxv3.common.synchronization [req-ecee7e81-3cc2-4f07-bbb3-f0b8984834e4 req-b682ac2c-b043-427b-9996-a92d30cd0e69 service nova] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 1084.334290] env[65136]: INFO networking_nsxv3.common.synchronization [req-ecee7e81-3cc2-4f07-bbb3-f0b8984834e4 req-b682ac2c-b043-427b-9996-a92d30cd0e69 service nova] Enqueued Resource ID: 0a45705b-eef9-4269-b3bb-a0a606bad56f with Priority: HIGHEST for action port [ 1084.334791] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_rules [ 1084.334930] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 1084.335040] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a45705b-eef9-4269-b3bb-a0a606bad56f with Priority: HIGHEST for action port [ 1084.335321] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.335442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.335523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.335727] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.335809] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.336714] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.336814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.337023] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a45705b-eef9-4269-b3bb-a0a606bad56f taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.337133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a45705b-eef9-4269-b3bb-a0a606bad56f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.337193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a45705b-eef9-4269-b3bb-a0a606bad56f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.337354] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a45705b-eef9-4269-b3bb-a0a606bad56f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.337523] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a45705b-eef9-4269-b3bb-a0a606bad56f',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.840081] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a45705b-eef9-4269-b3bb-a0a606bad56f with status ACTIVE [ 1084.840501] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.840501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.840501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.840649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.840724] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.841338] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.841338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.841338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.841629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.841629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.841820] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.841928] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.841973] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.842235] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.842235] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.842420] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a45705b-eef9-4269-b3bb-a0a606bad56f is going to be updated. [ 1084.843453] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.843637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.866038] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.866038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.866038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.866038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.866038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.866038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a45705b-eef9-4269-b3bb-a0a606bad56f" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.352441] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: SUCCESS [ 1085.352441] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c deletion is rescheduled due to dependency. [ 1085.352441] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.352831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.352831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.353057] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.353161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.353161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.353292] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.353371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.353521] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.776390] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 1085.776649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.776753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.776975] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.777178] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.777282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.777365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.777507] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.777591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.777649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.777730] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.856058] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.279926] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.280199] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.280272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.280543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.280686] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.280792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.280856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.281021] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.281212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.281314] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.281922] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.282111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.282193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.282344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.282496] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.282627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.282701] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.282900] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.282990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.283113] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.283239] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.357875] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.595913] env[65136]: INFO networking_nsxv3.common.synchronization [None req-2c89a7e0-82fd-4e1e-85c5-a711d8b9f051 tempest-AttachVolumeTestJSON-333791645 tempest-AttachVolumeTestJSON-333791645-project-member] Enqueued Resource ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 with Priority: HIGHEST for action security_group_rules [ 1086.596467] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 with Priority: HIGHEST for action security_group_rules [ 1086.596826] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.596898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.596955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.597203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.597288] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.682476] env[65136]: INFO networking_nsxv3.common.synchronization [None req-457836f4-61f2-47c5-a399-9734688c5e6b tempest-AttachVolumeTestJSON-333791645 tempest-AttachVolumeTestJSON-333791645-project-member] Enqueued Resource ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 with Priority: HIGHEST for action security_group_rules [ 1086.683478] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 with Priority: HIGHEST for action security_group_rules [ 1086.685025] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.685025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.785770] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ffd4802-244f-43db-9a7c-a5a1b6672fde: rpc.has_security_group_logging(os_id): False [ 1086.810548] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.810745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.810745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.810941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.811042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.811382] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.811517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.811517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.811654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.811728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.811897] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.811988] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.812069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.812217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.812279] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.812462] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.812547] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.812607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.812756] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.812827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.812912] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be created. [ 1086.860427] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.860766] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.860766] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.860841] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.860927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.861045] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c is going to be updated. [ 1086.912959] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.912959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.912959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.912959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.912959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.912959] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.912959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.912959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.912959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.912959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.912959] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: IN_PROGRESS for 2s [ 1086.912959] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: IN_PROGRESS for 2s [ 1087.123395] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.123395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.123395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.123395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.123395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.123395] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 already deleted. [ 1087.123395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.123395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.123395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.123395] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.453717] env[65136]: INFO networking_nsxv3.common.synchronization [req-d181f486-a80c-4eb3-9513-a47328da6b83 req-fc3e628e-c727-4eb5-aa87-df0a8b2cbab4 tempest-ServersTestManualDisk-933515256 tempest-ServersTestManualDisk-933515256-project-member] Enqueued Resource ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b with Priority: HIGHEST for action security_group_members [ 1087.454509] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b with Priority: HIGHEST for action security_group_members [ 1087.454748] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-627dff8d-ead1-4820-9473-3d8056d3cd8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.454874] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.454943] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.455226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.455679] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.455804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.455859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.456020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.456107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.456209] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('627dff8d-ead1-4820-9473-3d8056d3cd8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.645673] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.645865] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.645865] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.646110] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.646197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.646294] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 already deleted. [ 1087.646379] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.888854] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-812 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.889213] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-812" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.889213] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-812" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.889525] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-812" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.889791] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.889947] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.890073] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.890277] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.890577] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.890641] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.890714] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1087.890818] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1087.890922] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1087.891036] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1087.891208] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1087.891349] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1087.913680] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1087.913901] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1087.914026] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1087.914201] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-812" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.914510] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-e4eabd28-c19a-459a-b8bf-0962d0140633 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.914675] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-e4eabd28-c19a-459a-b8bf-0962d0140633" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.914788] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-e4eabd28-c19a-459a-b8bf-0962d0140633" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.915123] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-e4eabd28-c19a-459a-b8bf-0962d0140633" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.915254] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4eabd28-c19a-459a-b8bf-0962d0140633',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.959089] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.959270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.959310] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.959513] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.959606] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.959833] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.959931] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.959986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.960164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.960251] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.960340] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b already deleted. [ 1087.960417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.417589] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.417826] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.417955] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.418258] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.418407] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.418564] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port e4eabd28-c19a-459a-b8bf-0962d0140633 not found, creating... [ 1088.418824] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.418982] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.419149] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.419445] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.419589] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.419884] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.420052] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.420206] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.420462] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.420598] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.420736] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: e4eabd28-c19a-459a-b8bf-0962d0140633 is going to be created. [ 1088.443101] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.443381] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.443552] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.443878] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.444204] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.444469] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-e4eabd28-c19a-459a-b8bf-0962d0140633" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.891166] env[65136]: INFO networking_nsxv3.common.synchronization [req-ba5acad5-411b-4f5e-9595-c930275ea50c req-e73b0f9a-0e53-49f7-9f87-7352f11d7f49 tempest-DeleteServersTestJSON-1045367082 tempest-DeleteServersTestJSON-1045367082-project-member] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 1088.891443] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 1088.891751] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.891876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.891950] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.892233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.892393] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.892489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.892551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.892691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.892772] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.892865] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.912265] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: SUCCESS [ 1088.912488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.912643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.912856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.913059] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.913176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.913233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.913384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.913496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.913595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.913633] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.915943] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 1088.916182] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.158843] env[65136]: INFO networking_nsxv3.common.synchronization [req-d181f486-a80c-4eb3-9513-a47328da6b83 req-34636a4d-366f-425c-bded-32d0ef5f7847 service nova] Enqueued Resource ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b with Priority: HIGHEST for action security_group_rules [ 1089.158843] env[65136]: INFO networking_nsxv3.common.synchronization [req-d181f486-a80c-4eb3-9513-a47328da6b83 req-34636a4d-366f-425c-bded-32d0ef5f7847 service nova] Enqueued Resource ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b with Priority: HIGHEST for action security_group_members [ 1089.158843] env[65136]: INFO networking_nsxv3.common.synchronization [req-d181f486-a80c-4eb3-9513-a47328da6b83 req-34636a4d-366f-425c-bded-32d0ef5f7847 service nova] Enqueued Resource ID: e4eabd28-c19a-459a-b8bf-0962d0140633 with Priority: HIGHEST for action port [ 1089.158953] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b with Priority: HIGHEST for action security_group_rules [ 1089.160203] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b with Priority: HIGHEST for action security_group_members [ 1089.160203] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4eabd28-c19a-459a-b8bf-0962d0140633 with Priority: HIGHEST for action port [ 1089.160203] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-627dff8d-ead1-4820-9473-3d8056d3cd8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.160203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.160203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.160381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.160381] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('627dff8d-ead1-4820-9473-3d8056d3cd8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.162160] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-627dff8d-ead1-4820-9473-3d8056d3cd8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.162294] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.162366] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.162568] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.162721] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.162819] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.162883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.163041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.163128] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.163219] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('627dff8d-ead1-4820-9473-3d8056d3cd8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.164012] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4eabd28-c19a-459a-b8bf-0962d0140633 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.164116] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4eabd28-c19a-459a-b8bf-0962d0140633" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.164167] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4eabd28-c19a-459a-b8bf-0962d0140633" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.164333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4eabd28-c19a-459a-b8bf-0962d0140633" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.164415] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4eabd28-c19a-459a-b8bf-0962d0140633',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.394299] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.417387] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.666204] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('627dff8d-ead1-4820-9473-3d8056d3cd8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.667293] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-627dff8d-ead1-4820-9473-3d8056d3cd8b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.667405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.667588] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4eabd28-c19a-459a-b8bf-0962d0140633 with status ACTIVE [ 1089.667876] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.667876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.669048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.669048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.669048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.669048] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.669048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.669048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.669048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.669048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.669048] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.671111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.671111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.671111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.671111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.671111] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4eabd28-c19a-459a-b8bf-0962d0140633 is going to be updated. [ 1089.698102] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.698102] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.698102] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.698227] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.698327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.698484] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4eabd28-c19a-459a-b8bf-0962d0140633" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.896790] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.919921] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 341154f1-9b0b-43bc-8e74-163cf220f74c: rpc.has_security_group_logging(os_id): False [ 1089.942680] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.942680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.942680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.942680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.943161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.943161] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.943161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.943161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.943403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.943403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.943488] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c is going to be updated. [ 1090.020383] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.020632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.020687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.020889] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.021052] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.035410] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: IN_PROGRESS for 2s [ 1090.172893] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('627dff8d-ead1-4820-9473-3d8056d3cd8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.400070] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.400362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.400465] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.400714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.400847] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.401012] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 1090.438398] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.439690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.439690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.439690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.439690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.449661] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 1090.677342] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.677565] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.677639] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.677911] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.678015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.678135] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b is going to be created. [ 1090.703844] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.703989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.704077] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.704281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.704431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.714883] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b in Status: UNINITIALIZED for 2s [ 1092.050288] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: SUCCESS [ 1092.050288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.460092] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 1092.460380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.727137] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b in Status: SUCCESS [ 1092.727393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.727569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.727877] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.728194] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.728283] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.728347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.728601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.728601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.728696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.728793] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('627dff8d-ead1-4820-9473-3d8056d3cd8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.234253] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('627dff8d-ead1-4820-9473-3d8056d3cd8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.608290] env[65136]: INFO networking_nsxv3.common.synchronization [None req-fbba791d-0c6e-4786-bc5e-fa6fcef81412 None None] Enqueued Resource ID: 03f6bb8c-0732-4da0-a8b8-e647ac262189 with Priority: HIGHEST for action port [ 1093.608716] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03f6bb8c-0732-4da0-a8b8-e647ac262189 with Priority: HIGHEST for action port [ 1093.609035] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-03f6bb8c-0732-4da0-a8b8-e647ac262189 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.609286] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03f6bb8c-0732-4da0-a8b8-e647ac262189" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.609401] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03f6bb8c-0732-4da0-a8b8-e647ac262189" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.609695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03f6bb8c-0732-4da0-a8b8-e647ac262189" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.609782] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03f6bb8c-0732-4da0-a8b8-e647ac262189',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.737516] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 627dff8d-ead1-4820-9473-3d8056d3cd8b: rpc.has_security_group_logging(os_id): False [ 1093.756535] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.756642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.756695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.757547] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.757547] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.757547] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.757547] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.757547] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.757799] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.757799] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.757799] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b is going to be created. [ 1093.820707] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.821148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.821235] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.821514] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.821719] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.836721] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b in Status: IN_PROGRESS for 2s [ 1094.113255] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03f6bb8c-0732-4da0-a8b8-e647ac262189 [ 1094.113608] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.113752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.113812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.114231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.114231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.114348] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03f6bb8c-0732-4da0-a8b8-e647ac262189 already deleted. [ 1094.114393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03f6bb8c-0732-4da0-a8b8-e647ac262189" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.190579] env[65136]: INFO networking_nsxv3.common.synchronization [req-8732a388-f885-464b-90aa-41512b54e301 req-12f47b61-67aa-4983-ba53-d142dfa602d2 tempest-AttachVolumeShelveTestJSON-1302323664 tempest-AttachVolumeShelveTestJSON-1302323664-project-member] Enqueued Resource ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c with Priority: HIGHEST for action security_group_members [ 1094.191240] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c with Priority: HIGHEST for action security_group_members [ 1094.191546] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.191695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.191735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.192663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.192663] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.192663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.192817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.192888] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.192968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.193080] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.697791] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.698135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.698135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.698292] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.722230] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.722499] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.722618] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.722696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.722905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.722999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.723104] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c is going to be updated. [ 1094.752124] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.752457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.752457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.752649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.752822] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.762260] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c in Status: IN_PROGRESS for 2s [ 1095.503533] env[65136]: INFO networking_nsxv3.common.synchronization [req-225992fd-ccdb-49fa-9eab-daf3fb956d40 req-daabc4d6-205f-453f-82a1-3b2409d06301 tempest-ServerRescueNegativeTestJSON-1746403212 tempest-ServerRescueNegativeTestJSON-1746403212-project-member] Enqueued Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_members [ 1095.504966] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_members [ 1095.507557] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e076b0f0-4401-42ce-b608-41c3e6db24f9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.507792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.507850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.508139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.508371] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.508518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.508616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.508833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.508953] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.509113] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.850528] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b in Status: SUCCESS [ 1095.850528] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.938947] env[65136]: INFO networking_nsxv3.common.synchronization [req-21e5f9c8-6fff-4a8c-a443-2860d90e89d0 req-ed5c274c-2484-41c1-9725-dbaafb8fcb3d tempest-ServersTestJSON-425456513 tempest-ServersTestJSON-425456513-project-member] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1095.939772] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1095.939814] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.939944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.940016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.940218] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.940378] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.940476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.940535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.940676] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.940761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.940851] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.011355] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.159361] env[65136]: INFO networking_nsxv3.common.synchronization [None req-0255199d-c3b1-4b89-ab1f-840c445cf0bb None None] Enqueued Resource ID: 56892458-3a1f-48d3-8fb5-005c10378f2e with Priority: HIGHEST for action port [ 1096.159935] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56892458-3a1f-48d3-8fb5-005c10378f2e with Priority: HIGHEST for action port [ 1096.160373] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-56892458-3a1f-48d3-8fb5-005c10378f2e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.160460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56892458-3a1f-48d3-8fb5-005c10378f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.160460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56892458-3a1f-48d3-8fb5-005c10378f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.160773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56892458-3a1f-48d3-8fb5-005c10378f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.160773] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56892458-3a1f-48d3-8fb5-005c10378f2e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.236054] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.236054] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.236054] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.236238] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.236363] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.236518] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.236634] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.236842] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.236986] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.237209] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.237975] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.237975] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.237975] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.237975] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.237975] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.237975] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.259021] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.259021] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1096.259021] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.259021] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.259021] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-e9aa1d46-902b-4b63-b835-afc6090ea91d taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.259021] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-e9aa1d46-902b-4b63-b835-afc6090ea91d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.259021] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-e9aa1d46-902b-4b63-b835-afc6090ea91d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.259021] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-e9aa1d46-902b-4b63-b835-afc6090ea91d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.259021] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9aa1d46-902b-4b63-b835-afc6090ea91d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.443411] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.514234] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.668847] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56892458-3a1f-48d3-8fb5-005c10378f2e [ 1096.669104] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.669241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.669312] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.669555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.669643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.669743] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56892458-3a1f-48d3-8fb5-005c10378f2e already deleted. [ 1096.669823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56892458-3a1f-48d3-8fb5-005c10378f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.762440] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.762684] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.762810] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.763099] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.763253] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.763448] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port e9aa1d46-902b-4b63-b835-afc6090ea91d not found, creating... [ 1096.763720] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.763880] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.764031] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.764272] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.764443] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.764730] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.764934] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.765090] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.765298] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.765441] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.766475] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: e9aa1d46-902b-4b63-b835-afc6090ea91d is going to be created. [ 1096.778138] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c in Status: SUCCESS [ 1096.778661] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c deletion is rescheduled due to dependency. [ 1096.778796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.786928] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.787170] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.787272] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.787533] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.788059] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.788059] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-e9aa1d46-902b-4b63-b835-afc6090ea91d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.946521] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.017077] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.017259] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.017586] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.017586] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.017683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.017740] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 is going to be updated. [ 1097.047014] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.047173] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.047245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.047833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.047833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.056262] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 in Status: IN_PROGRESS for 2s [ 1097.449577] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.449577] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.449577] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.449577] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.449776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.449776] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1097.492021] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.492193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.492254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.492480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.492619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.505078] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1097.578365] env[65136]: INFO networking_nsxv3.common.synchronization [req-21e5f9c8-6fff-4a8c-a443-2860d90e89d0 req-08919900-967e-497a-a761-598ce2f5e5b9 service nova] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_rules [ 1097.578365] env[65136]: INFO networking_nsxv3.common.synchronization [req-21e5f9c8-6fff-4a8c-a443-2860d90e89d0 req-08919900-967e-497a-a761-598ce2f5e5b9 service nova] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1097.578365] env[65136]: INFO networking_nsxv3.common.synchronization [req-21e5f9c8-6fff-4a8c-a443-2860d90e89d0 req-08919900-967e-497a-a761-598ce2f5e5b9 service nova] Enqueued Resource ID: e9aa1d46-902b-4b63-b835-afc6090ea91d with Priority: HIGHEST for action port [ 1097.578365] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_rules [ 1097.578365] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1097.579959] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9aa1d46-902b-4b63-b835-afc6090ea91d with Priority: HIGHEST for action port [ 1097.579959] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.579959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.579959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.580322] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.580322] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.581185] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.581378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.582023] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9aa1d46-902b-4b63-b835-afc6090ea91d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.582388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9aa1d46-902b-4b63-b835-afc6090ea91d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.582388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9aa1d46-902b-4b63-b835-afc6090ea91d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.582485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9aa1d46-902b-4b63-b835-afc6090ea91d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.582513] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9aa1d46-902b-4b63-b835-afc6090ea91d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.667337] env[65136]: INFO networking_nsxv3.common.synchronization [None req-793ca8c4-ad19-4a56-98cf-367b50f7e8ff tempest-AttachVolumeShelveTestJSON-1302323664 tempest-AttachVolumeShelveTestJSON-1302323664-project-member] Enqueued Resource ID: 34781a01-2f7c-494e-a20f-c65d97596e05 with Priority: HIGHEST for action security_group_rules [ 1097.667870] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34781a01-2f7c-494e-a20f-c65d97596e05 with Priority: HIGHEST for action security_group_rules [ 1097.668329] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34781a01-2f7c-494e-a20f-c65d97596e05 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.668329] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.668749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.668749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.668749] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34781a01-2f7c-494e-a20f-c65d97596e05',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.751022] env[65136]: INFO networking_nsxv3.common.synchronization [None req-669b0946-fdbb-4a77-9228-f38c2210ef2a tempest-AttachVolumeShelveTestJSON-1302323664 tempest-AttachVolumeShelveTestJSON-1302323664-project-member] Enqueued Resource ID: 34781a01-2f7c-494e-a20f-c65d97596e05 with Priority: HIGHEST for action security_group_rules [ 1097.751022] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34781a01-2f7c-494e-a20f-c65d97596e05 with Priority: HIGHEST for action security_group_rules [ 1097.752935] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34781a01-2f7c-494e-a20f-c65d97596e05 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.753099] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.086106] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.089189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.089189] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9aa1d46-902b-4b63-b835-afc6090ea91d with status ACTIVE [ 1098.089189] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.089189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.089189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.089189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.089189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.089189] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.089189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.089189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.089189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.089189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.089189] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.089189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.089189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.089189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.089189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.089663] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9aa1d46-902b-4b63-b835-afc6090ea91d is going to be updated. [ 1098.114533] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.114714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.114818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.115097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.115282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.115503] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9aa1d46-902b-4b63-b835-afc6090ea91d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.195054] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.195054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.195054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.195054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.195054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.195054] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34781a01-2f7c-494e-a20f-c65d97596e05 already deleted. [ 1098.195054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.195054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.195054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.195054] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34781a01-2f7c-494e-a20f-c65d97596e05',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.630329] env[65136]: INFO networking_nsxv3.common.synchronization [req-7c456daf-c198-4734-8678-56a91ad8f4b5 req-6d245c86-c0e7-4faa-be9a-f6fe7e5e9b16 tempest-AttachVolumeTestJSON-333791645 tempest-AttachVolumeTestJSON-333791645-project-member] Enqueued Resource ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 with Priority: HIGHEST for action security_group_members [ 1098.631050] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 with Priority: HIGHEST for action security_group_members [ 1098.631438] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.631578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.631653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.631892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.632171] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.632340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.632340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.632508] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.632548] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.632645] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.720195] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.720345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.720420] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.720628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.720926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.720926] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34781a01-2f7c-494e-a20f-c65d97596e05 already deleted. [ 1098.720926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.000907] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-121 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.001112] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-121" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.001500] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-121" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.001564] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-121" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.001816] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.001970] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.005192] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.005192] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.005192] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.005192] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.005192] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1099.005192] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1099.005192] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1099.005192] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.005595] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1099.005595] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1099.026860] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1099.027266] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1099.027591] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1099.027728] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-121" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.028064] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-2d2c002c-210e-454f-bd41-6634c5f1398c taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.028241] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-2d2c002c-210e-454f-bd41-6634c5f1398c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.028379] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-2d2c002c-210e-454f-bd41-6634c5f1398c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.028713] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-2d2c002c-210e-454f-bd41-6634c5f1398c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.028851] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d2c002c-210e-454f-bd41-6634c5f1398c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.066269] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 in Status: SUCCESS [ 1099.066488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.134492] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.134835] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.134835] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.135027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.135027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.135321] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.135457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.135531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.135686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.135811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.135945] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 already deleted. [ 1099.136078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.523714] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1099.523932] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.524489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.524728] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.524915] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.525056] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.525149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.525397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.525481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.525580] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.534680] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.535163] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.535389] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.535770] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.535980] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.536166] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 2d2c002c-210e-454f-bd41-6634c5f1398c not found, creating... [ 1099.536440] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.536612] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.536803] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.537070] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.537245] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.537564] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.537789] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.538182] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.538766] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.538766] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.539192] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 2d2c002c-210e-454f-bd41-6634c5f1398c is going to be created. [ 1099.562577] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.562786] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.562912] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.563211] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.563548] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.563666] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-2d2c002c-210e-454f-bd41-6634c5f1398c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.637672] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-998 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.637909] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.638049] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.638329] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.638638] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.638803] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.638920] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.639147] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.639295] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.639514] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.639627] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1099.639738] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1099.639844] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1099.639961] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.640081] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1099.640213] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1099.661884] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1099.661884] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1099.662123] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1099.662163] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-998" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.662515] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-aa5c6b1d-2c99-4be1-af36-f6132e683e65 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.662700] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.662850] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.663145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.663289] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa5c6b1d-2c99-4be1-af36-f6132e683e65',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.031799] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.165826] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.166150] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.166202] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.166468] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.166619] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.166896] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.167064] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.167220] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.167457] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.167592] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.167873] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.168077] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.168160] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.168362] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.168496] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.168681] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: aa5c6b1d-2c99-4be1-af36-f6132e683e65 is going to be updated. [ 1100.193128] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.193335] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.193458] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.193749] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.193994] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.194241] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.230644] env[65136]: INFO networking_nsxv3.common.synchronization [req-7c456daf-c198-4734-8678-56a91ad8f4b5 req-14cc19e2-c587-4a73-9338-0378f350d4b4 service nova] Enqueued Resource ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 with Priority: HIGHEST for action security_group_rules [ 1100.230832] env[65136]: INFO networking_nsxv3.common.synchronization [req-7c456daf-c198-4734-8678-56a91ad8f4b5 req-14cc19e2-c587-4a73-9338-0378f350d4b4 service nova] Enqueued Resource ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 with Priority: HIGHEST for action security_group_members [ 1100.230975] env[65136]: INFO networking_nsxv3.common.synchronization [req-7c456daf-c198-4734-8678-56a91ad8f4b5 req-14cc19e2-c587-4a73-9338-0378f350d4b4 service nova] Enqueued Resource ID: 2d2c002c-210e-454f-bd41-6634c5f1398c with Priority: HIGHEST for action port [ 1100.231526] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 with Priority: HIGHEST for action security_group_rules [ 1100.231663] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 with Priority: HIGHEST for action security_group_members [ 1100.231761] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d2c002c-210e-454f-bd41-6634c5f1398c with Priority: HIGHEST for action port [ 1100.232402] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.232560] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.232636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.232868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.232956] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.236812] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.236938] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.237013] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.237229] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.237390] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.237488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.237550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.237696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.237778] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.237872] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.239025] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d2c002c-210e-454f-bd41-6634c5f1398c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.240037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d2c002c-210e-454f-bd41-6634c5f1398c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.240037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d2c002c-210e-454f-bd41-6634c5f1398c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.240037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d2c002c-210e-454f-bd41-6634c5f1398c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.240037] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d2c002c-210e-454f-bd41-6634c5f1398c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.534176] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.686155] env[65136]: INFO networking_nsxv3.common.synchronization [req-057f6c19-2ab2-4e81-b842-5e190c0bcc95 req-86fa7d1b-e91e-4c70-8123-f82bb974e557 tempest-ServerAddressesNegativeTestJSON-697925889 tempest-ServerAddressesNegativeTestJSON-697925889-project-member] Enqueued Resource ID: 50fff4b6-41a4-4814-b10b-190839692ac8 with Priority: HIGHEST for action security_group_members [ 1100.687678] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50fff4b6-41a4-4814-b10b-190839692ac8 with Priority: HIGHEST for action security_group_members [ 1100.688144] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-50fff4b6-41a4-4814-b10b-190839692ac8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.688326] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.688375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.688626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.688793] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.688895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.688951] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.689128] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.689210] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.689306] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50fff4b6-41a4-4814-b10b-190839692ac8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.741519] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.741724] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.742094] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.743107] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d2c002c-210e-454f-bd41-6634c5f1398c with status ACTIVE [ 1100.743303] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.743417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.743487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.743684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.743771] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.743945] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.745075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.745075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.745075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.745251] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.745315] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.745413] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.745558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.745602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.745673] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.745758] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d2c002c-210e-454f-bd41-6634c5f1398c is going to be updated. [ 1100.768364] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.768566] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.768671] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.768894] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.769045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.769223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d2c002c-210e-454f-bd41-6634c5f1398c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.886847] env[65136]: INFO networking_nsxv3.common.synchronization [req-edb82bec-ed22-4846-b9b5-5fa4cc023bd9 req-e9130f64-69e5-4f39-b3bf-4e540ec66c81 service nova] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_rules [ 1100.887034] env[65136]: INFO networking_nsxv3.common.synchronization [req-edb82bec-ed22-4846-b9b5-5fa4cc023bd9 req-e9130f64-69e5-4f39-b3bf-4e540ec66c81 service nova] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 1100.887182] env[65136]: INFO networking_nsxv3.common.synchronization [req-edb82bec-ed22-4846-b9b5-5fa4cc023bd9 req-e9130f64-69e5-4f39-b3bf-4e540ec66c81 service nova] Enqueued Resource ID: aa5c6b1d-2c99-4be1-af36-f6132e683e65 with Priority: HIGHEST for action port [ 1100.887417] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_rules [ 1100.887557] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 1100.887656] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa5c6b1d-2c99-4be1-af36-f6132e683e65 with Priority: HIGHEST for action port [ 1100.888325] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.888468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.888539] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.888758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.888840] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.889856] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.889974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.890057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.890226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.890482] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.890590] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.890634] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.892340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.892340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.892340] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.892340] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa5c6b1d-2c99-4be1-af36-f6132e683e65 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.892340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.892340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.892340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.892340] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa5c6b1d-2c99-4be1-af36-f6132e683e65',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.022401] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-962 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.022655] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-962" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.022789] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-962" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.023070] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-962" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.023348] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.023504] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.023622] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.023864] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.024503] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.024766] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.024884] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.024997] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.025146] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.025352] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.025352] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.025549] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.036855] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.036962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.037009] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.037233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.038100] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.038230] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1101.045145] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.045334] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1101.045716] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.045716] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-962" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.046039] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-1c289ec3-1e2e-46dc-a90b-a92685f3261e taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.046225] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-1c289ec3-1e2e-46dc-a90b-a92685f3261e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.046344] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-1c289ec3-1e2e-46dc-a90b-a92685f3261e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.046674] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-1c289ec3-1e2e-46dc-a90b-a92685f3261e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.047272] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c289ec3-1e2e-46dc-a90b-a92685f3261e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.065350] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.065539] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.065673] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.065758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.065896] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.075376] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1101.191808] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.192140] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.192140] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.192299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.192409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.192619] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.192722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.192784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.192939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.193029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.193112] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50fff4b6-41a4-4814-b10b-190839692ac8 already deleted. [ 1101.193192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.247931] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.394488] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.394815] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.395109] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.396205] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa5c6b1d-2c99-4be1-af36-f6132e683e65 with status ACTIVE [ 1101.396446] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.396589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.396678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.396954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.397083] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.397745] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.397745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.397745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.397745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.398114] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.398114] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.398224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.398280] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.398462] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.398564] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.398688] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa5c6b1d-2c99-4be1-af36-f6132e683e65 is going to be updated. [ 1101.422769] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.423012] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.423097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.423370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.423547] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.423785] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa5c6b1d-2c99-4be1-af36-f6132e683e65" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.549411] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.549664] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.549740] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.550792] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.550792] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.550792] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 1c289ec3-1e2e-46dc-a90b-a92685f3261e not found, creating... [ 1101.550792] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.551023] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.551023] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.551198] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.551337] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.551666] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.551818] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.551933] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.552179] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.553033] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.553033] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 1c289ec3-1e2e-46dc-a90b-a92685f3261e is going to be created. [ 1101.575012] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.575258] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.575386] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.575654] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.575885] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.576121] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-1c289ec3-1e2e-46dc-a90b-a92685f3261e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.750907] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.751075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.751150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.751371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.751630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.751794] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 is going to be created. [ 1101.781242] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.781242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.781242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.781242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.781242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.794193] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 in Status: UNINITIALIZED for 2s [ 1101.901256] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.320046] env[65136]: INFO networking_nsxv3.common.synchronization [req-057f6c19-2ab2-4e81-b842-5e190c0bcc95 req-b6a331e7-e90f-49ec-8627-7909694f81e8 service nova] Enqueued Resource ID: 50fff4b6-41a4-4814-b10b-190839692ac8 with Priority: HIGHEST for action security_group_rules [ 1102.320046] env[65136]: INFO networking_nsxv3.common.synchronization [req-057f6c19-2ab2-4e81-b842-5e190c0bcc95 req-b6a331e7-e90f-49ec-8627-7909694f81e8 service nova] Enqueued Resource ID: 50fff4b6-41a4-4814-b10b-190839692ac8 with Priority: HIGHEST for action security_group_members [ 1102.320366] env[65136]: INFO networking_nsxv3.common.synchronization [req-057f6c19-2ab2-4e81-b842-5e190c0bcc95 req-b6a331e7-e90f-49ec-8627-7909694f81e8 service nova] Enqueued Resource ID: 1c289ec3-1e2e-46dc-a90b-a92685f3261e with Priority: HIGHEST for action port [ 1102.320662] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50fff4b6-41a4-4814-b10b-190839692ac8 with Priority: HIGHEST for action security_group_rules [ 1102.320798] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50fff4b6-41a4-4814-b10b-190839692ac8 with Priority: HIGHEST for action security_group_members [ 1102.320893] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c289ec3-1e2e-46dc-a90b-a92685f3261e with Priority: HIGHEST for action port [ 1102.321222] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50fff4b6-41a4-4814-b10b-190839692ac8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.321331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.321398] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.321737] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.321818] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50fff4b6-41a4-4814-b10b-190839692ac8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.322773] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-50fff4b6-41a4-4814-b10b-190839692ac8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.322891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.323829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.323829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.323829] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.323829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.323829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.323829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.323829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.323829] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50fff4b6-41a4-4814-b10b-190839692ac8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.325861] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c289ec3-1e2e-46dc-a90b-a92685f3261e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.325935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c289ec3-1e2e-46dc-a90b-a92685f3261e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.325968] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c289ec3-1e2e-46dc-a90b-a92685f3261e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.327038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c289ec3-1e2e-46dc-a90b-a92685f3261e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.327038] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c289ec3-1e2e-46dc-a90b-a92685f3261e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.404265] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.405726] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.405857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.406095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.406214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.406323] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be updated. [ 1102.440400] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.440400] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.440400] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.440534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.440847] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.452713] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: IN_PROGRESS for 2s [ 1102.828469] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-50fff4b6-41a4-4814-b10b-190839692ac8 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.828599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.828841] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('50fff4b6-41a4-4814-b10b-190839692ac8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.830531] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c289ec3-1e2e-46dc-a90b-a92685f3261e with status ACTIVE [ 1102.830802] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.830880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.830961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.831284] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.831284] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.831550] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.831699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.831699] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.831831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.831909] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.832321] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.832370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.832818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.832818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.832818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.832818] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c289ec3-1e2e-46dc-a90b-a92685f3261e is going to be updated. [ 1102.867562] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.867714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.867785] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.867994] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.868161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.868324] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c289ec3-1e2e-46dc-a90b-a92685f3261e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.086496] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1103.086771] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.086945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.087185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.087425] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.087548] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.087611] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.087765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.087829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.087918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.088051] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.331989] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('50fff4b6-41a4-4814-b10b-190839692ac8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.590771] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.590939] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.591020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.591272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.591447] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.591610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.591674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.591837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.591921] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.592033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.592209] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.592800] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.592924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.593139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.594247] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.594247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.594247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.594247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.594247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.594247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.594247] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.811798] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 in Status: SUCCESS [ 1103.812034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.812209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.814043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.814043] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.814043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.814043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.814043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.814043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.814043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.814043] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.833919] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.834130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.834209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.834423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.834527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.834647] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50fff4b6-41a4-4814-b10b-190839692ac8 is going to be created. [ 1103.862942] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.863260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.863260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.863518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.863656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.875289] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50fff4b6-41a4-4814-b10b-190839692ac8 in Status: UNINITIALIZED for 2s [ 1104.097901] env[65136]: INFO networking_nsxv3.common.synchronization [req-a851621c-b2af-4ddd-8924-79faa652bf7e req-794162b8-95a4-41fb-b1fc-2d0393d1eae7 tempest-AttachVolumeNegativeTest-40195811 tempest-AttachVolumeNegativeTest-40195811-project-member] Enqueued Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGHEST for action security_group_members [ 1104.097901] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a99f7e35-ad71-4640-a081-3c507e997901: rpc.has_security_group_logging(os_id): False [ 1104.098909] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGHEST for action security_group_members [ 1104.099399] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7b37bfd-119e-4a70-9b16-a4796e90a688 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.099742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.099928] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.100239] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.100754] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.100976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.101132] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.101386] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.101655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.101842] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7b37bfd-119e-4a70-9b16-a4796e90a688',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.120524] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.120855] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.121045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.121292] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.121531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.121728] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.121970] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.122526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.122526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.122526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.123017] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.123017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.123524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.123763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.123896] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.124134] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.124237] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.124316] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.124454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.124532] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.124643] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1104.190259] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.190445] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.190590] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.191299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.191299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.208086] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1104.319419] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.340685] env[65136]: INFO networking_nsxv3.common.synchronization [req-7b8e43ae-9a61-42db-95e4-01909981416f req-1c4831ef-e0ed-4492-ab7e-5eaa1fe0f7a5 tempest-ServerRescueNegativeTestJSON-1746403212 tempest-ServerRescueNegativeTestJSON-1746403212-project-member] Enqueued Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_members [ 1104.340685] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 with Priority: HIGHEST for action security_group_members [ 1104.340685] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e076b0f0-4401-42ce-b608-41c3e6db24f9 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.340685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.340685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.340685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.340685] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.340685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.340685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.340685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.341381] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.341381] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e076b0f0-4401-42ce-b608-41c3e6db24f9',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.465623] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 1104.465623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.465818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.465948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.466168] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.466294] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.466359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.466519] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.466592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.466682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.466773] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.606066] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.606066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.606066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.606066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.606409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.606409] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.606584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.606584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.606685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.606774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.606867] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 is going to be updated. [ 1104.644585] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.644776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.644812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.645050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.645199] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.655484] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 in Status: IN_PROGRESS for 2s [ 1104.818801] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331: rpc.has_security_group_logging(os_id): False [ 1104.837252] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.837491] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.837567] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.837789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.837884] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.838172] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.838332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.838332] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.838476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.838550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.838639] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 is going to be created. [ 1104.843545] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.843545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.843545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.843782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.863209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.863467] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.863586] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.863657] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.863879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.863962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.864095] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 is going to be updated. [ 1104.900895] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.901050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.901128] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.901334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.901478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.905427] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.905558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.905627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.905819] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.906014] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.913367] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 in Status: IN_PROGRESS for 2s [ 1104.915163] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 in Status: IN_PROGRESS for 2s [ 1104.969777] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.969964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.970046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.970254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.970447] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.970595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.970666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.970830] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.971183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.971183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.971183] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.971307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.971307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.971963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.971963] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.971963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.971963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.971963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.971963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.972219] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.972219] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.474505] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ffd4802-244f-43db-9a7c-a5a1b6672fde: rpc.has_security_group_logging(os_id): False [ 1105.493863] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.494089] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.494147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.494512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.494512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.494672] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.495786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.495786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.495786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.495786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.495786] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.495786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.495786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.495786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.495786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.495786] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.495786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.496199] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.496199] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.496199] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.496199] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be updated. [ 1105.561829] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.561983] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.562048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.562258] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.562404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.579116] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: IN_PROGRESS for 2s [ 1105.711315] env[65136]: INFO networking_nsxv3.common.synchronization [req-e3c9615a-393d-4f42-9e29-0034be20dc08 req-1b2a06f1-e27b-4a79-b8a1-8a408942b9f8 tempest-AttachVolumeShelveTestJSON-1302323664 tempest-AttachVolumeShelveTestJSON-1302323664-project-member] Enqueued Resource ID: 34781a01-2f7c-494e-a20f-c65d97596e05 with Priority: HIGHEST for action security_group_members [ 1105.711890] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34781a01-2f7c-494e-a20f-c65d97596e05 with Priority: HIGHEST for action security_group_members [ 1105.712217] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-34781a01-2f7c-494e-a20f-c65d97596e05 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.712573] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.712651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.712911] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.713082] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.713184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.713246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.713391] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.713536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.713572] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34781a01-2f7c-494e-a20f-c65d97596e05',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.888410] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50fff4b6-41a4-4814-b10b-190839692ac8 in Status: SUCCESS [ 1105.888630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.888802] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.889035] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.889230] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.889348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.889418] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.889575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.889655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.889737] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.889827] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('50fff4b6-41a4-4814-b10b-190839692ac8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.039470] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-330 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.039470] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-330" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.039706] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-330" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.039892] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-330" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.040233] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.040393] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.040510] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.040763] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.040913] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.041153] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.041256] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1106.041367] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1106.041659] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1106.041903] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1106.041995] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1106.042148] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1106.065364] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1106.065522] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1106.065687] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1106.065871] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-330" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.066220] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-215d3e21-85a1-4b52-b58d-f27653d408eb taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.066424] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-215d3e21-85a1-4b52-b58d-f27653d408eb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.066549] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-215d3e21-85a1-4b52-b58d-f27653d408eb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.066931] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-215d3e21-85a1-4b52-b58d-f27653d408eb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.067187] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('215d3e21-85a1-4b52-b58d-f27653d408eb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.216248] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.216470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.216541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.216757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.216870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.217116] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.217228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.217319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.217488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.217591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.217684] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34781a01-2f7c-494e-a20f-c65d97596e05 already deleted. [ 1106.217795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.227372] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1106.227641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.392016] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-50fff4b6-41a4-4814-b10b-190839692ac8 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.392290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.392435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.392767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.392929] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.393194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.393194] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.393377] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.393438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.393536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.393919] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-50fff4b6-41a4-4814-b10b-190839692ac8 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.393919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.393919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.394181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.394325] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.394325] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.394543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.394543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.394610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.394694] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.395076] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('50fff4b6-41a4-4814-b10b-190839692ac8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.482094] env[65136]: INFO networking_nsxv3.common.synchronization [req-c2f25d2b-3bde-4cd6-8eac-cc4329c4df0a req-3fddd755-60d5-4842-8b15-4383d58ff844 tempest-DeleteServersTestJSON-1045367082 tempest-DeleteServersTestJSON-1045367082-project-member] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 1106.482651] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGHEST for action security_group_members [ 1106.482940] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.483354] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.483520] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.483739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.483945] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.484106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.484206] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.484396] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.484528] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.484663] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.569678] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.569775] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.569913] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.570245] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.570416] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.570588] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 215d3e21-85a1-4b52-b58d-f27653d408eb not found, creating... [ 1106.570867] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.571103] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.571252] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.571597] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.571769] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.572123] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.572315] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.572462] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.572789] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.572938] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.573124] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 215d3e21-85a1-4b52-b58d-f27653d408eb is going to be created. [ 1106.593696] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.593947] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.594129] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.594417] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.594688] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.594982] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-215d3e21-85a1-4b52-b58d-f27653d408eb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.673887] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 in Status: SUCCESS [ 1106.673887] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 deletion is rescheduled due to dependency. [ 1106.674160] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.897499] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 50fff4b6-41a4-4814-b10b-190839692ac8: rpc.has_security_group_logging(os_id): False [ 1106.916418] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.916593] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.916680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.916931] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.917044] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.917266] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.917333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.917406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.917589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.917682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.917903] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.918037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.918102] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.918263] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.918350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.918549] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.918646] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.918715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.918920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.919013] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.919104] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50fff4b6-41a4-4814-b10b-190839692ac8 is going to be created. [ 1106.929959] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 in Status: SUCCESS [ 1106.930687] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e076b0f0-4401-42ce-b608-41c3e6db24f9 deletion is rescheduled due to dependency. [ 1106.930687] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e076b0f0-4401-42ce-b608-41c3e6db24f9" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.931637] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 in Status: SUCCESS [ 1106.931835] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.979093] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.979262] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.979317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.979518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.979729] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.986495] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.986638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.986638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.986868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.986979] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.987191] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.987289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.987348] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.987515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.987588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.987673] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be updated. [ 1106.990935] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50fff4b6-41a4-4814-b10b-190839692ac8 in Status: IN_PROGRESS for 2s [ 1107.015572] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.015751] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.015751] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.015923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.016146] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.025821] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: IN_PROGRESS for 2s [ 1107.302924] env[65136]: INFO networking_nsxv3.common.synchronization [req-e3c9615a-393d-4f42-9e29-0034be20dc08 req-108eace2-79d2-447c-af1f-a50655fd857a service nova] Enqueued Resource ID: 34781a01-2f7c-494e-a20f-c65d97596e05 with Priority: HIGHEST for action security_group_rules [ 1107.302924] env[65136]: INFO networking_nsxv3.common.synchronization [req-e3c9615a-393d-4f42-9e29-0034be20dc08 req-108eace2-79d2-447c-af1f-a50655fd857a service nova] Enqueued Resource ID: 34781a01-2f7c-494e-a20f-c65d97596e05 with Priority: HIGHEST for action security_group_members [ 1107.303100] env[65136]: INFO networking_nsxv3.common.synchronization [req-e3c9615a-393d-4f42-9e29-0034be20dc08 req-108eace2-79d2-447c-af1f-a50655fd857a service nova] Enqueued Resource ID: 215d3e21-85a1-4b52-b58d-f27653d408eb with Priority: HIGHEST for action port [ 1107.303720] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34781a01-2f7c-494e-a20f-c65d97596e05 with Priority: HIGHEST for action security_group_rules [ 1107.303881] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34781a01-2f7c-494e-a20f-c65d97596e05 with Priority: HIGHEST for action security_group_members [ 1107.303980] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 215d3e21-85a1-4b52-b58d-f27653d408eb with Priority: HIGHEST for action port [ 1107.304562] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34781a01-2f7c-494e-a20f-c65d97596e05 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.304694] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.304761] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.305031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.305123] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34781a01-2f7c-494e-a20f-c65d97596e05',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.306887] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-34781a01-2f7c-494e-a20f-c65d97596e05 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.307743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.307743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.307743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.307743] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.307743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.307743] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.308014] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.308014] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.308014] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34781a01-2f7c-494e-a20f-c65d97596e05',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.309041] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-215d3e21-85a1-4b52-b58d-f27653d408eb taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.309041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-215d3e21-85a1-4b52-b58d-f27653d408eb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.309207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-215d3e21-85a1-4b52-b58d-f27653d408eb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.309289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-215d3e21-85a1-4b52-b58d-f27653d408eb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.309375] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('215d3e21-85a1-4b52-b58d-f27653d408eb',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.596179] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 1107.596515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.811606] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-34781a01-2f7c-494e-a20f-c65d97596e05 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.811724] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.812050] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34781a01-2f7c-494e-a20f-c65d97596e05',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.812855] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 215d3e21-85a1-4b52-b58d-f27653d408eb with status ACTIVE [ 1107.813058] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.813174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.813242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.813437] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.813524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.813692] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.813788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.813843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.814089] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.814168] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.814346] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.814432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.815036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.815036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.815036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.815036] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 215d3e21-85a1-4b52-b58d-f27653d408eb is going to be updated. [ 1107.835850] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.836050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.836050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.836257] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.836388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.836552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-215d3e21-85a1-4b52-b58d-f27653d408eb" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.317438] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34781a01-2f7c-494e-a20f-c65d97596e05',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.763713] env[65136]: INFO networking_nsxv3.common.synchronization [req-c471107a-75ff-4e93-8f5c-46b97d1fef9f req-6cd24b12-5a0b-4df4-9165-02e541fcfcb3 tempest-ServersTestJSON-425456513 tempest-ServersTestJSON-425456513-project-member] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1108.764344] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1108.764677] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.764811] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.764923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.765079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.765226] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.765358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.765654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.765654] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.765802] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.765802] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.820088] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.820251] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.820390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.820550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.820647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.820748] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34781a01-2f7c-494e-a20f-c65d97596e05 is going to be created. [ 1108.851410] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.851631] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.851710] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.852094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.852193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.863514] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34781a01-2f7c-494e-a20f-c65d97596e05 in Status: UNINITIALIZED for 2s [ 1109.005479] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 50fff4b6-41a4-4814-b10b-190839692ac8 in Status: SUCCESS [ 1109.005479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.036394] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 in Status: SUCCESS [ 1109.036570] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 deletion is rescheduled due to dependency. [ 1109.036688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.202998] env[65136]: INFO networking_nsxv3.common.synchronization [None req-32a0068e-b921-4f0d-97c0-6c153691e05f tempest-AttachVolumeNegativeTest-40195811 tempest-AttachVolumeNegativeTest-40195811-project-member] Enqueued Resource ID: 442ff863-0294-4912-9ccc-90fba7170dc2 with Priority: HIGHEST for action security_group_rules [ 1109.203879] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 442ff863-0294-4912-9ccc-90fba7170dc2 with Priority: HIGHEST for action security_group_rules [ 1109.203947] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-442ff863-0294-4912-9ccc-90fba7170dc2 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.204101] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.204406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.204537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.204537] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('442ff863-0294-4912-9ccc-90fba7170dc2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.268139] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.298235] env[65136]: INFO networking_nsxv3.common.synchronization [None req-e4ca3810-a4e5-44d8-9b8e-0f1da053e226 tempest-AttachVolumeNegativeTest-40195811 tempest-AttachVolumeNegativeTest-40195811-project-member] Enqueued Resource ID: 442ff863-0294-4912-9ccc-90fba7170dc2 with Priority: HIGHEST for action security_group_rules [ 1109.298235] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 442ff863-0294-4912-9ccc-90fba7170dc2 with Priority: HIGHEST for action security_group_rules [ 1109.298506] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-442ff863-0294-4912-9ccc-90fba7170dc2 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.298603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.725411] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.725590] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.725630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.725833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.725938] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.726072] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 442ff863-0294-4912-9ccc-90fba7170dc2 already deleted. [ 1109.726162] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.726318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.726479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.726562] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('442ff863-0294-4912-9ccc-90fba7170dc2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.772102] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.248755] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.248907] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.248982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.249202] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.249287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.249381] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 442ff863-0294-4912-9ccc-90fba7170dc2 already deleted. [ 1110.249461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.274253] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.274408] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.274477] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.274695] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.274924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.274924] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1110.307044] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.307198] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.307268] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.307496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.307642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.320157] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1110.873366] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34781a01-2f7c-494e-a20f-c65d97596e05 in Status: SUCCESS [ 1110.873612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.873753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.873962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.874170] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.874290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.874357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.874510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.874587] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.874672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.875115] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34781a01-2f7c-494e-a20f-c65d97596e05',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.377610] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34781a01-2f7c-494e-a20f-c65d97596e05',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.880037] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34781a01-2f7c-494e-a20f-c65d97596e05: rpc.has_security_group_logging(os_id): False [ 1111.899437] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.899682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.899783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.900018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.900124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.900386] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.900486] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.900551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.900720] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.900798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.900883] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34781a01-2f7c-494e-a20f-c65d97596e05 is going to be created. [ 1111.984835] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.985039] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.985077] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.985281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.985464] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.996691] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34781a01-2f7c-494e-a20f-c65d97596e05 in Status: IN_PROGRESS for 2s [ 1112.334905] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1112.335210] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.739362] env[65136]: INFO networking_nsxv3.common.synchronization [req-25d77116-5f23-44aa-a90b-5a08017b1f57 req-a0f92812-b1ca-4763-8a05-962330ac78e8 tempest-ServerAddressesNegativeTestJSON-697925889 tempest-ServerAddressesNegativeTestJSON-697925889-project-member] Enqueued Resource ID: 50fff4b6-41a4-4814-b10b-190839692ac8 with Priority: HIGHEST for action security_group_members [ 1113.740602] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50fff4b6-41a4-4814-b10b-190839692ac8 with Priority: HIGHEST for action security_group_members [ 1113.740602] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-50fff4b6-41a4-4814-b10b-190839692ac8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.740602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.740828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.740966] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.741228] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.741342] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.741428] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.741602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.741786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.741840] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('50fff4b6-41a4-4814-b10b-190839692ac8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.012490] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34781a01-2f7c-494e-a20f-c65d97596e05 in Status: SUCCESS [ 1114.012726] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.245326] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.245515] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.245561] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.245760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.245969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.246203] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.246306] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.246367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.246527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.246604] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.246688] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50fff4b6-41a4-4814-b10b-190839692ac8 is going to be updated. [ 1114.275619] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.275619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.275619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.275851] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.277148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.286019] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50fff4b6-41a4-4814-b10b-190839692ac8 in Status: IN_PROGRESS for 2s [ 1115.136292] env[65136]: INFO networking_nsxv3.common.synchronization [req-3a1d3cda-288b-40da-ac04-1ac6e55eb426 req-f1cb1fba-4eec-4a0f-a1e8-81ed86ee9cbd tempest-AttachVolumeNegativeTest-40195811 tempest-AttachVolumeNegativeTest-40195811-project-member] Enqueued Resource ID: 442ff863-0294-4912-9ccc-90fba7170dc2 with Priority: HIGHEST for action security_group_members [ 1115.136849] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 442ff863-0294-4912-9ccc-90fba7170dc2 with Priority: HIGHEST for action security_group_members [ 1115.137169] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-442ff863-0294-4912-9ccc-90fba7170dc2 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.137296] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.137350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.137601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.137751] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.137852] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.137911] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.138068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.138154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.138261] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('442ff863-0294-4912-9ccc-90fba7170dc2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.515437] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-525 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.515672] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-525" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.515838] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-525" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.516555] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-525" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.516886] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.517178] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.517395] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.517758] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.518030] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.518319] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.518476] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.518601] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.518721] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.518835] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.518942] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.519202] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.543327] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.543527] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1115.543651] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.543836] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-525" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.544202] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-9a2f41f5-0c71-497a-b006-05bdf6065b5a taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.544364] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-9a2f41f5-0c71-497a-b006-05bdf6065b5a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.544487] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-9a2f41f5-0c71-497a-b006-05bdf6065b5a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.544843] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-9a2f41f5-0c71-497a-b006-05bdf6065b5a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.544985] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a2f41f5-0c71-497a-b006-05bdf6065b5a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.640416] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.640604] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.640639] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.640947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.641069] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.641325] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.641426] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.641487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.641650] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.641774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.641879] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 442ff863-0294-4912-9ccc-90fba7170dc2 already deleted. [ 1115.641913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.047650] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.047931] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.047988] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.048344] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.048508] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.048731] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 9a2f41f5-0c71-497a-b006-05bdf6065b5a not found, creating... [ 1116.049014] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.049203] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.049325] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.049575] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.049741] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.050167] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.050365] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.050494] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.050723] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.050902] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.051041] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 9a2f41f5-0c71-497a-b006-05bdf6065b5a is going to be created. [ 1116.074813] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.075058] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.075278] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.075435] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.075666] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.076020] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-9a2f41f5-0c71-497a-b006-05bdf6065b5a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.296626] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 50fff4b6-41a4-4814-b10b-190839692ac8 in Status: SUCCESS [ 1116.297456] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 50fff4b6-41a4-4814-b10b-190839692ac8 deletion is rescheduled due to dependency. [ 1116.297456] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.815487] env[65136]: INFO networking_nsxv3.common.synchronization [req-3a1d3cda-288b-40da-ac04-1ac6e55eb426 req-fb63c651-5a2e-40fc-b804-2e595eaf9f0a service nova] Enqueued Resource ID: 442ff863-0294-4912-9ccc-90fba7170dc2 with Priority: HIGHEST for action security_group_rules [ 1116.815656] env[65136]: INFO networking_nsxv3.common.synchronization [req-3a1d3cda-288b-40da-ac04-1ac6e55eb426 req-fb63c651-5a2e-40fc-b804-2e595eaf9f0a service nova] Enqueued Resource ID: 442ff863-0294-4912-9ccc-90fba7170dc2 with Priority: HIGHEST for action security_group_members [ 1116.815800] env[65136]: INFO networking_nsxv3.common.synchronization [req-3a1d3cda-288b-40da-ac04-1ac6e55eb426 req-fb63c651-5a2e-40fc-b804-2e595eaf9f0a service nova] Enqueued Resource ID: 9a2f41f5-0c71-497a-b006-05bdf6065b5a with Priority: HIGHEST for action port [ 1116.816386] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 442ff863-0294-4912-9ccc-90fba7170dc2 with Priority: HIGHEST for action security_group_rules [ 1116.816526] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 442ff863-0294-4912-9ccc-90fba7170dc2 with Priority: HIGHEST for action security_group_members [ 1116.816621] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a2f41f5-0c71-497a-b006-05bdf6065b5a with Priority: HIGHEST for action port [ 1116.816908] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-442ff863-0294-4912-9ccc-90fba7170dc2 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.817039] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.817111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.817311] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.817393] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('442ff863-0294-4912-9ccc-90fba7170dc2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.818260] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-442ff863-0294-4912-9ccc-90fba7170dc2 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.818372] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.818441] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.818605] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.818751] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.818848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.818913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.819119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.819255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.819384] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('442ff863-0294-4912-9ccc-90fba7170dc2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.820291] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a2f41f5-0c71-497a-b006-05bdf6065b5a taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.820409] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a2f41f5-0c71-497a-b006-05bdf6065b5a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.820477] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a2f41f5-0c71-497a-b006-05bdf6065b5a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.820667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a2f41f5-0c71-497a-b006-05bdf6065b5a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.820713] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a2f41f5-0c71-497a-b006-05bdf6065b5a',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.196432] env[65136]: INFO networking_nsxv3.common.synchronization [None req-f11068af-a3db-4594-9cb8-a95de5314220 None None] Enqueued Resource ID: 6c559120-190b-4c6e-b85b-bed4f8773f87 with Priority: HIGHEST for action port [ 1117.197058] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c559120-190b-4c6e-b85b-bed4f8773f87 with Priority: HIGHEST for action port [ 1117.198761] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c559120-190b-4c6e-b85b-bed4f8773f87 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.198920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c559120-190b-4c6e-b85b-bed4f8773f87" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.198991] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c559120-190b-4c6e-b85b-bed4f8773f87" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.199264] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c559120-190b-4c6e-b85b-bed4f8773f87" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.199351] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c559120-190b-4c6e-b85b-bed4f8773f87',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.323350] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('442ff863-0294-4912-9ccc-90fba7170dc2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.324444] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-442ff863-0294-4912-9ccc-90fba7170dc2 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.324541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.324700] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a2f41f5-0c71-497a-b006-05bdf6065b5a with status ACTIVE [ 1117.324856] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.324963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.325050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.325260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.325349] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.325523] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.325618] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.325681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.325837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.325927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.326155] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.326252] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.326314] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.326455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.326528] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.326612] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a2f41f5-0c71-497a-b006-05bdf6065b5a is going to be updated. [ 1117.348333] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.348333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.348333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.348333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.348333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.348333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a2f41f5-0c71-497a-b006-05bdf6065b5a" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.350835] env[65136]: INFO networking_nsxv3.common.synchronization [None req-472cb8f3-2ca5-454a-a202-73e1de95d84e tempest-ServerActionsTestOtherA-1102352866 tempest-ServerActionsTestOtherA-1102352866-project-member] Enqueued Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_rules [ 1117.351447] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_rules [ 1117.352647] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3d3368d-c817-476c-9744-dc804689a94b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.352647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.352647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.353128] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.354273] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.446485] env[65136]: INFO networking_nsxv3.common.synchronization [None req-eb8fa6ec-f893-491c-9491-d34a943efc4d tempest-ServerActionsTestOtherA-1102352866 tempest-ServerActionsTestOtherA-1102352866-project-member] Enqueued Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_rules [ 1117.446998] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_rules [ 1117.447330] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3d3368d-c817-476c-9744-dc804689a94b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.447431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.702111] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6c559120-190b-4c6e-b85b-bed4f8773f87 [ 1117.702814] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.702814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.702814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.703441] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.703780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.703903] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6c559120-190b-4c6e-b85b-bed4f8773f87 already deleted. [ 1117.703996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c559120-190b-4c6e-b85b-bed4f8773f87" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.829021] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('442ff863-0294-4912-9ccc-90fba7170dc2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.874959] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.875133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.875222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.875413] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.875501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.875598] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3d3368d-c817-476c-9744-dc804689a94b already deleted. [ 1117.875680] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.875825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.875970] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.876061] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.335290] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.335290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.335290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.335290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.335290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.335290] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 442ff863-0294-4912-9ccc-90fba7170dc2 is going to be created. [ 1118.371843] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.372054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.372126] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.372356] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.372673] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.383543] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 442ff863-0294-4912-9ccc-90fba7170dc2 in Status: UNINITIALIZED for 2s [ 1118.404925] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.405305] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.405477] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.405843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.406714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.406714] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3d3368d-c817-476c-9744-dc804689a94b already deleted. [ 1118.406714] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.088066] env[65136]: INFO networking_nsxv3.common.synchronization [None req-db40b9ab-675e-47a5-bd2e-33596c361bae None None] Enqueued Resource ID: 86bf2bf8-ed74-4084-891a-ad5ebc4d7bee with Priority: HIGHEST for action port [ 1120.088066] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86bf2bf8-ed74-4084-891a-ad5ebc4d7bee with Priority: HIGHEST for action port [ 1120.088066] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-86bf2bf8-ed74-4084-891a-ad5ebc4d7bee taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.088066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86bf2bf8-ed74-4084-891a-ad5ebc4d7bee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.088066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86bf2bf8-ed74-4084-891a-ad5ebc4d7bee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.088457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86bf2bf8-ed74-4084-891a-ad5ebc4d7bee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.088689] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86bf2bf8-ed74-4084-891a-ad5ebc4d7bee',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.319145] env[65136]: INFO networking_nsxv3.common.synchronization [req-a0e63021-efc6-423c-b381-d3910c66642f req-6778f624-6b5e-44d6-ac10-33cab5d57843 tempest-ServersTestJSON-425456513 tempest-ServersTestJSON-425456513-project-member] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1120.319770] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1120.320101] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.320241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.320313] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.320621] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.320659] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.320757] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.320809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.320952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.321048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.321145] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.397864] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 442ff863-0294-4912-9ccc-90fba7170dc2 in Status: SUCCESS [ 1120.397864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.397864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.397864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.398125] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.398125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.398125] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.398238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.398534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.398534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.398534] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('442ff863-0294-4912-9ccc-90fba7170dc2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.592175] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86bf2bf8-ed74-4084-891a-ad5ebc4d7bee [ 1120.592416] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.592556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.592633] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.593012] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.593147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.593253] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86bf2bf8-ed74-4084-891a-ad5ebc4d7bee already deleted. [ 1120.593359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86bf2bf8-ed74-4084-891a-ad5ebc4d7bee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.747545] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-197 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.747743] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.747882] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.748203] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.748484] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.748655] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.748775] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.749027] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.750286] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.750532] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.750659] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.750772] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.750892] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.751017] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.751183] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.751267] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.771537] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.771672] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1120.771818] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.773008] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-197" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.773008] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-19ba55de-c1ac-415a-96b4-ecf26119e431 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.773008] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-19ba55de-c1ac-415a-96b4-ecf26119e431" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.773008] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-19ba55de-c1ac-415a-96b4-ecf26119e431" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.773324] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-19ba55de-c1ac-415a-96b4-ecf26119e431" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.773324] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19ba55de-c1ac-415a-96b4-ecf26119e431',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.824333] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.902502] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('442ff863-0294-4912-9ccc-90fba7170dc2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.151388] env[65136]: INFO networking_nsxv3.common.synchronization [req-0e281b31-8758-42a2-ac30-088c22572ef1 req-58e4300d-00fb-4677-b6ae-99cbd10f0062 tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_members [ 1121.151388] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_members [ 1121.151707] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.152204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.152204] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.152454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.152454] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.152537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.152613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.152827] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.152873] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.153011] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.276811] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.277057] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.277057] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.277422] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.277577] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.278589] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 19ba55de-c1ac-415a-96b4-ecf26119e431 not found, creating... [ 1121.278927] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.279614] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.279614] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.279614] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.279614] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.279833] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.280011] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.280898] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.281150] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.281295] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.281443] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 19ba55de-c1ac-415a-96b4-ecf26119e431 is going to be created. [ 1121.305083] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.305083] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.305083] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.305083] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.305300] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.305437] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-19ba55de-c1ac-415a-96b4-ecf26119e431" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.326719] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.404925] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 442ff863-0294-4912-9ccc-90fba7170dc2: rpc.has_security_group_logging(os_id): False [ 1121.429413] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.429604] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.429706] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.430655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.430655] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.430805] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.430858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.430887] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.431203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.431203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.431303] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 442ff863-0294-4912-9ccc-90fba7170dc2 is going to be created. [ 1121.518439] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.518630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.518630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.518798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.519058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.532507] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 442ff863-0294-4912-9ccc-90fba7170dc2 in Status: IN_PROGRESS for 2s [ 1121.632417] env[65136]: INFO networking_nsxv3.common.synchronization [req-389e90ea-18a2-4132-b275-8092faba50ee req-347ef039-452a-479f-9d13-46ee6832f373 tempest-ServersTestBootFromVolume-1565380015 tempest-ServersTestBootFromVolume-1565380015-project-member] Enqueued Resource ID: a0070031-3f89-4a59-8e86-79ba8d922e5b with Priority: HIGHEST for action security_group_members [ 1121.633219] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0070031-3f89-4a59-8e86-79ba8d922e5b with Priority: HIGHEST for action security_group_members [ 1121.634351] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0070031-3f89-4a59-8e86-79ba8d922e5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.634351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.634351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.634351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.634351] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.634351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.634351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.634721] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.634721] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.634721] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0070031-3f89-4a59-8e86-79ba8d922e5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.655365] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.831376] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.831376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.831376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.831376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.831376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.831376] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1121.861470] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.861470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.861470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.861470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.861470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.869842] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1122.045566] env[65136]: INFO networking_nsxv3.common.synchronization [req-a0e63021-efc6-423c-b381-d3910c66642f req-0b73292f-9481-4e58-ba9b-518f2e7a24a0 service nova] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_rules [ 1122.045772] env[65136]: INFO networking_nsxv3.common.synchronization [req-a0e63021-efc6-423c-b381-d3910c66642f req-0b73292f-9481-4e58-ba9b-518f2e7a24a0 service nova] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1122.045913] env[65136]: INFO networking_nsxv3.common.synchronization [req-a0e63021-efc6-423c-b381-d3910c66642f req-0b73292f-9481-4e58-ba9b-518f2e7a24a0 service nova] Enqueued Resource ID: 19ba55de-c1ac-415a-96b4-ecf26119e431 with Priority: HIGHEST for action port [ 1122.046449] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_rules [ 1122.046585] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1122.046684] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19ba55de-c1ac-415a-96b4-ecf26119e431 with Priority: HIGHEST for action port [ 1122.046951] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.047146] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.047239] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.047464] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.047598] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.048496] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.048642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.048865] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-19ba55de-c1ac-415a-96b4-ecf26119e431 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.048971] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19ba55de-c1ac-415a-96b4-ecf26119e431" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.049046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19ba55de-c1ac-415a-96b4-ecf26119e431" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.049265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19ba55de-c1ac-415a-96b4-ecf26119e431" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.049365] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19ba55de-c1ac-415a-96b4-ecf26119e431',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.136305] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.136481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.136529] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.136737] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.136826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.137033] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.137136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.137201] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.137351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.137428] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.137513] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0070031-3f89-4a59-8e86-79ba8d922e5b is going to be updated. [ 1122.156995] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.163771] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.163908] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.163981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.164861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.164861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.174866] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0070031-3f89-4a59-8e86-79ba8d922e5b in Status: IN_PROGRESS for 2s [ 1122.551474] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.551729] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.551809] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19ba55de-c1ac-415a-96b4-ecf26119e431 with status ACTIVE [ 1122.551967] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.552163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.552163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.552383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.552472] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.552643] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.552747] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.552792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.552959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.553076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.553247] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.553378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.553378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.553518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.553594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.553661] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19ba55de-c1ac-415a-96b4-ecf26119e431 is going to be updated. [ 1122.592657] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.592947] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.593097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.593358] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.593555] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.593774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19ba55de-c1ac-415a-96b4-ecf26119e431" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.658860] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.659104] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.659104] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.659325] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.659417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.659521] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e is going to be updated. [ 1122.708419] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.708618] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.708618] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.708831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.708972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.718822] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e in Status: IN_PROGRESS for 2s [ 1123.155734] env[65136]: INFO networking_nsxv3.common.synchronization [req-7fa9035c-f27b-437a-88c5-7d92f3c386d2 req-55a21e15-2df5-4aae-bdc2-7872331184f4 tempest-ServerActionsTestOtherA-1102352866 tempest-ServerActionsTestOtherA-1102352866-project-member] Enqueued Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_members [ 1123.156410] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_members [ 1123.160427] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d3368d-c817-476c-9744-dc804689a94b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.160722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.160722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.160919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.161113] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.161212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.161274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.161443] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.161529] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.161625] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.546030] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 442ff863-0294-4912-9ccc-90fba7170dc2 in Status: SUCCESS [ 1123.546030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.560862] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.561060] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.561060] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.561518] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.561827] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.562167] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.562378] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.562721] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.562978] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.563352] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.563556] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.563728] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.563897] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.564088] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.564256] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.564459] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.584305] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.584517] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1123.584598] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.584785] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.585134] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-84d345c1-453c-43a0-b812-2a4f63e4b656 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.585313] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-84d345c1-453c-43a0-b812-2a4f63e4b656" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.585436] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-84d345c1-453c-43a0-b812-2a4f63e4b656" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.585767] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-84d345c1-453c-43a0-b812-2a4f63e4b656" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.585906] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84d345c1-453c-43a0-b812-2a4f63e4b656',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.664533] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.664709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.664786] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.665016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.665119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.665483] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.665483] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.665483] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.665629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.665708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.665757] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d3368d-c817-476c-9744-dc804689a94b already deleted. [ 1123.665837] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.881181] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1123.881613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.882019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.882279] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.882486] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.882612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.882681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.882845] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.882978] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.883119] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.088308] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.088574] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.088836] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.089118] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.089321] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.089514] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 84d345c1-453c-43a0-b812-2a4f63e4b656 not found, creating... [ 1124.089838] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.090117] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.090306] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.090660] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.090807] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.091171] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.091387] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.091576] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.091837] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.092069] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.092227] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 84d345c1-453c-43a0-b812-2a4f63e4b656 is going to be created. [ 1124.117681] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.117681] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.118036] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.118222] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.118389] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.118644] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-84d345c1-453c-43a0-b812-2a4f63e4b656" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.184241] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0070031-3f89-4a59-8e86-79ba8d922e5b in Status: SUCCESS [ 1124.184609] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0070031-3f89-4a59-8e86-79ba8d922e5b deletion is rescheduled due to dependency. [ 1124.184609] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.386831] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.739490] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e in Status: SUCCESS [ 1124.739775] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.847736] env[65136]: INFO networking_nsxv3.common.synchronization [req-7fa9035c-f27b-437a-88c5-7d92f3c386d2 req-c365e227-1e86-4952-bbc3-43cc65409db0 service nova] Enqueued Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_rules [ 1124.847736] env[65136]: INFO networking_nsxv3.common.synchronization [req-7fa9035c-f27b-437a-88c5-7d92f3c386d2 req-c365e227-1e86-4952-bbc3-43cc65409db0 service nova] Enqueued Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_members [ 1124.847736] env[65136]: INFO networking_nsxv3.common.synchronization [req-7fa9035c-f27b-437a-88c5-7d92f3c386d2 req-c365e227-1e86-4952-bbc3-43cc65409db0 service nova] Enqueued Resource ID: 84d345c1-453c-43a0-b812-2a4f63e4b656 with Priority: HIGHEST for action port [ 1124.847736] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_rules [ 1124.848062] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_members [ 1124.848062] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84d345c1-453c-43a0-b812-2a4f63e4b656 with Priority: HIGHEST for action port [ 1124.848936] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3d3368d-c817-476c-9744-dc804689a94b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.848936] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.848936] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.849435] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.849525] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.851325] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d3368d-c817-476c-9744-dc804689a94b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.851583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.851659] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.851847] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.852110] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.852211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.852289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.852456] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.852541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.852634] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.853956] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-84d345c1-453c-43a0-b812-2a4f63e4b656 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.854078] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84d345c1-453c-43a0-b812-2a4f63e4b656" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.854146] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84d345c1-453c-43a0-b812-2a4f63e4b656" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.854322] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84d345c1-453c-43a0-b812-2a4f63e4b656" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.854401] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84d345c1-453c-43a0-b812-2a4f63e4b656',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.889474] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.352039] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d3368d-c817-476c-9744-dc804689a94b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.352382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.354565] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.356908] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84d345c1-453c-43a0-b812-2a4f63e4b656 with status ACTIVE [ 1125.358020] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.358020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.358020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.358020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.358020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.358020] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.358020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.358020] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.359595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.359595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.359595] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.359595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.359595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.359595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.359595] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.359595] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84d345c1-453c-43a0-b812-2a4f63e4b656 is going to be updated. [ 1125.387018] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.387018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.387018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.387018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.387018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.387269] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84d345c1-453c-43a0-b812-2a4f63e4b656" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.392080] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.392289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.392375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.392575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.392661] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.392760] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1125.425653] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.425927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.425990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.426252] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.426638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.439251] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1125.857826] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.360312] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.360607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.360607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.360783] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.360879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.360982] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d3368d-c817-476c-9744-dc804689a94b is going to be created. [ 1126.400616] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.400850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.400986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.401272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.401478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.417165] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: UNINITIALIZED for 2s [ 1127.070334] env[65136]: INFO networking_nsxv3.common.synchronization [req-9242bb4e-7c86-4e4a-be66-fb3b488ecca2 req-c90918e5-0361-4c0b-a9bf-42ffeec5bb78 tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_members [ 1127.070861] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e with Priority: HIGHEST for action security_group_members [ 1127.071042] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.071530] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.071603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.071808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.072044] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.072210] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.072249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.072389] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.072474] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.072569] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb9ff62c-64bb-4ec0-8e08-87a27863a22e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.450343] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1127.450653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.450723] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.450938] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.451559] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.451559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.451559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.451559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.451774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.451774] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.451855] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.577037] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.577037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.577037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.577037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.602577] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.604481] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.604481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.604481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.604481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.604481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.604481] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e is going to be updated. [ 1127.633481] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.633804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.633804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.633935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.634013] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.644107] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e in Status: IN_PROGRESS for 2s [ 1127.954582] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.954799] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.954799] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.955034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.955214] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.955322] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.955386] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.955545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.955649] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.955770] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.955930] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.956041] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.956106] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.956255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.956395] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.956489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.956550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.956688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.956765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.956848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.956941] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.428404] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: SUCCESS [ 1128.428688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.428948] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.429183] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.429424] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.429588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.429715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.429881] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.430015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.430148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.430247] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.459913] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a99f7e35-ad71-4640-a081-3c507e997901: rpc.has_security_group_logging(os_id): False [ 1128.481022] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.481022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.481022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.481022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.481022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.481022] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.481022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.481022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.481022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.481022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.481022] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.481022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.481022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.481022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.481022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.481642] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.481642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.481642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.481642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.481642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.481642] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1128.539875] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.540161] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.540282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.540643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.540908] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.560082] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1128.933208] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.436327] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3d3368d-c817-476c-9744-dc804689a94b: rpc.has_security_group_logging(os_id): False [ 1129.456894] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.457174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.457316] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.457689] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.457881] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.458287] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.458485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.458630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.458878] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.459562] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.459815] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3d3368d-c817-476c-9744-dc804689a94b is going to be created. [ 1129.534379] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.534867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.534867] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.535037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.535167] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.548140] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: IN_PROGRESS for 2s [ 1129.657057] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e in Status: SUCCESS [ 1129.657247] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb9ff62c-64bb-4ec0-8e08-87a27863a22e deletion is rescheduled due to dependency. [ 1129.657444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb9ff62c-64bb-4ec0-8e08-87a27863a22e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.576589] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1130.576962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.562376] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: SUCCESS [ 1131.562432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.642509] env[65136]: INFO networking_nsxv3.common.synchronization [None req-f1e758a6-1171-467c-8d27-c44462a24f20 tempest-AttachInterfacesTestJSON-152440310 tempest-AttachInterfacesTestJSON-152440310-project-member] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 1131.643059] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGHEST for action security_group_members [ 1131.643436] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.643565] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.643629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.643828] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.643975] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.644089] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.644138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.644274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.644417] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.644538] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.147350] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.147350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.147350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.147610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.147610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.147713] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.148628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.148628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.148628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.148628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.148628] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be updated. [ 1132.178573] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.178684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.178735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.178922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.179083] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.189591] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: IN_PROGRESS for 2s [ 1134.201644] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde in Status: SUCCESS [ 1134.201644] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde deletion is rescheduled due to dependency. [ 1134.201644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.828737] env[65136]: INFO networking_nsxv3.common.synchronization [None req-88793a56-9838-4a30-acf6-0f8a8166b99d None None] Enqueued Resource ID: 2f7d73d0-1ad4-483c-ab1f-0de051fd0190 with Priority: HIGHEST for action port [ 1135.829454] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f7d73d0-1ad4-483c-ab1f-0de051fd0190 with Priority: HIGHEST for action port [ 1135.829560] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f7d73d0-1ad4-483c-ab1f-0de051fd0190 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.829681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f7d73d0-1ad4-483c-ab1f-0de051fd0190" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.829748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f7d73d0-1ad4-483c-ab1f-0de051fd0190" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.830017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f7d73d0-1ad4-483c-ab1f-0de051fd0190" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.830107] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f7d73d0-1ad4-483c-ab1f-0de051fd0190',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.335423] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f7d73d0-1ad4-483c-ab1f-0de051fd0190 [ 1136.335423] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.335423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.335423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.335423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.335423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.335423] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f7d73d0-1ad4-483c-ab1f-0de051fd0190 already deleted. [ 1136.335423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f7d73d0-1ad4-483c-ab1f-0de051fd0190" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.431040] env[65136]: INFO networking_nsxv3.common.synchronization [None req-68d5dd11-fdab-44b8-a5f6-f2abbd4c39be tempest-AttachInterfacesUnderV243Test-374684262 tempest-AttachInterfacesUnderV243Test-374684262-project-member] Enqueued Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_rules [ 1136.431757] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_rules [ 1136.432362] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-621b4f7d-88fc-45a0-8c33-ede262410127 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.432362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.432362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.432666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.432736] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.558781] env[65136]: INFO networking_nsxv3.common.synchronization [None req-15860452-6521-4b0f-b916-81ce19a5f22e tempest-AttachInterfacesUnderV243Test-374684262 tempest-AttachInterfacesUnderV243Test-374684262-project-member] Enqueued Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_rules [ 1136.558781] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_rules [ 1136.558781] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-621b4f7d-88fc-45a0-8c33-ede262410127 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.558781] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.958277] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.958628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.958628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.958801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.958892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.959025] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 621b4f7d-88fc-45a0-8c33-ede262410127 already deleted. [ 1136.959114] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.959256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.959580] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.959580] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.270846] env[65136]: INFO networking_nsxv3.common.synchronization [req-88c59159-2b13-4153-b087-2f43720f847e req-eda347a3-3efd-4822-94fd-01e86589e39a tempest-ServersTestJSON-425456513 tempest-ServersTestJSON-425456513-project-member] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1137.271272] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1137.271631] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.271792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.271881] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.272201] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.272433] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.272577] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.272681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.272920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.273087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.273241] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.482334] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.482527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.482527] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.483504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.483504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.483504] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 621b4f7d-88fc-45a0-8c33-ede262410127 already deleted. [ 1137.483504] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.776291] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.279707] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.414748] env[65136]: INFO networking_nsxv3.common.synchronization [None req-5977b9cc-58ae-4911-af4c-c0f5e4addaf5 None None] Enqueued Resource ID: 7cdf6375-36db-4b56-925e-36821a201603 with Priority: HIGHEST for action port [ 1138.415691] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cdf6375-36db-4b56-925e-36821a201603 with Priority: HIGHEST for action port [ 1138.415691] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cdf6375-36db-4b56-925e-36821a201603 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.415831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cdf6375-36db-4b56-925e-36821a201603" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.415831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cdf6375-36db-4b56-925e-36821a201603" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.416093] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cdf6375-36db-4b56-925e-36821a201603" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.416168] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cdf6375-36db-4b56-925e-36821a201603',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.782114] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.782373] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.782492] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.782798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.782943] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.783112] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1138.810549] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.810709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.810749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.810970] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.811207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.820569] env[65136]: INFO networking_nsxv3.common.synchronization [req-fffff730-c314-483d-880e-25bf7ba6e67c req-2909adcf-50fc-4ef0-bf18-5728966ab20d tempest-ServersTestManualDisk-933515256 tempest-ServersTestManualDisk-933515256-project-member] Enqueued Resource ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b with Priority: HIGHEST for action security_group_members [ 1138.821496] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1138.821930] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b with Priority: HIGHEST for action security_group_members [ 1138.823290] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-627dff8d-ead1-4820-9473-3d8056d3cd8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.824334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.824334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.824334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.824334] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.824334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.824334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.824334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.824334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.825138] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('627dff8d-ead1-4820-9473-3d8056d3cd8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.918042] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7cdf6375-36db-4b56-925e-36821a201603 [ 1138.918284] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.918419] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.918476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.918746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.918859] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.918966] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7cdf6375-36db-4b56-925e-36821a201603 already deleted. [ 1138.919058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cdf6375-36db-4b56-925e-36821a201603" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.327049] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.327410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.327410] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.327534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.327634] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.327850] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.327951] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.328025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.328178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.328254] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.328340] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b is going to be updated. [ 1139.358833] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.359256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.359256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.359522] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.359717] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.370721] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b in Status: IN_PROGRESS for 2s [ 1140.831737] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1140.832076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.380899] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b in Status: SUCCESS [ 1141.381099] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b deletion is rescheduled due to dependency. [ 1141.381213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.590110] env[65136]: INFO networking_nsxv3.common.synchronization [req-929ed154-867c-4d9d-9dd1-81b3e7bad45b req-64f443d0-f4e1-4edd-8242-9d546ebba11f tempest-AttachInterfacesUnderV243Test-374684262 tempest-AttachInterfacesUnderV243Test-374684262-project-member] Enqueued Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_members [ 1143.591178] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_members [ 1143.591178] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-621b4f7d-88fc-45a0-8c33-ede262410127 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.591178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.591178] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.591505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.591537] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.591626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.591690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.591807] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.591897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.591990] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.697487] env[65136]: INFO networking_nsxv3.common.synchronization [req-3a27ead3-dc5a-41d3-916a-f3fd54399b29 req-45542c9e-0a58-43db-8523-5f4cd3211356 tempest-ServersTestJSON-425456513 tempest-ServersTestJSON-425456513-project-member] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1143.698583] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGHEST for action security_group_members [ 1143.698896] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.701698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.701698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.701698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.701698] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.701698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.701698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.701698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.701698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.701698] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.921290] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-356 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.921520] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-356" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.921651] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-356" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.921969] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-356" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.922239] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.922451] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.922605] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.922831] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.922975] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.923200] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.923314] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.923544] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.923742] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.923874] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.923993] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.924148] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.944822] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.945031] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1143.945191] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.945370] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-356" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.945678] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-13e99389-845f-42e3-aae4-c16c37bb3bc8 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.945848] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.945968] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.946294] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.946477] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13e99389-845f-42e3-aae4-c16c37bb3bc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.094455] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.094613] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.094703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.094916] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.095015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.095213] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.095312] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.095380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.095524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.095599] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.095683] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 621b4f7d-88fc-45a0-8c33-ede262410127 already deleted. [ 1144.095762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.203948] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.204120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.204192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.204423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.204518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.204728] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.204823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.204889] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.205058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.205134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.205221] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be updated. [ 1144.231210] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.231371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.231423] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.231690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.231838] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.240578] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: IN_PROGRESS for 2s [ 1144.448393] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.448731] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.448835] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.449170] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.449418] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.449628] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 13e99389-845f-42e3-aae4-c16c37bb3bc8 not found, creating... [ 1144.449942] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.450158] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.450308] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.450574] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.450760] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.451102] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.451329] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.451447] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.451700] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.451879] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.452051] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 13e99389-845f-42e3-aae4-c16c37bb3bc8 is going to be created. [ 1144.473485] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.474237] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.474237] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.474237] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.474477] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.474727] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.166575] env[65136]: INFO networking_nsxv3.common.synchronization [req-929ed154-867c-4d9d-9dd1-81b3e7bad45b req-92b93506-7caf-4782-9352-7cce33acefd9 service nova] Enqueued Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_rules [ 1145.166824] env[65136]: INFO networking_nsxv3.common.synchronization [req-929ed154-867c-4d9d-9dd1-81b3e7bad45b req-92b93506-7caf-4782-9352-7cce33acefd9 service nova] Enqueued Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_members [ 1145.166856] env[65136]: INFO networking_nsxv3.common.synchronization [req-929ed154-867c-4d9d-9dd1-81b3e7bad45b req-92b93506-7caf-4782-9352-7cce33acefd9 service nova] Enqueued Resource ID: 13e99389-845f-42e3-aae4-c16c37bb3bc8 with Priority: HIGHEST for action port [ 1145.167366] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_rules [ 1145.167503] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_members [ 1145.167603] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e99389-845f-42e3-aae4-c16c37bb3bc8 with Priority: HIGHEST for action port [ 1145.167878] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-621b4f7d-88fc-45a0-8c33-ede262410127 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.169137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.169137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.169137] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.169137] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.169314] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-621b4f7d-88fc-45a0-8c33-ede262410127 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.169616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.169616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.169746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.169937] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.170070] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.170138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.170965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.171390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.171390] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.172382] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-13e99389-845f-42e3-aae4-c16c37bb3bc8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.172382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.172549] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.172620] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.172693] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13e99389-845f-42e3-aae4-c16c37bb3bc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.674538] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.675740] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-621b4f7d-88fc-45a0-8c33-ede262410127 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.675865] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.676225] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13e99389-845f-42e3-aae4-c16c37bb3bc8 with status ACTIVE [ 1145.676411] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.676520] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.676586] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.676789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.676876] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.677053] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.677149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.677216] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.677405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.677537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.677598] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.677702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.677767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.678025] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.678111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.678197] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13e99389-845f-42e3-aae4-c16c37bb3bc8 is going to be updated. [ 1145.699832] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.700068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.700068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.700259] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.700403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.700574] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.176767] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.251107] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a99f7e35-ad71-4640-a081-3c507e997901 in Status: SUCCESS [ 1146.251289] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a99f7e35-ad71-4640-a081-3c507e997901 deletion is rescheduled due to dependency. [ 1146.251403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.679438] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.679601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.679700] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.679881] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.679989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.680101] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 621b4f7d-88fc-45a0-8c33-ede262410127 is going to be created. [ 1146.707499] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.707499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.707663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.708369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.708369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.719425] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 621b4f7d-88fc-45a0-8c33-ede262410127 in Status: UNINITIALIZED for 2s [ 1148.730883] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 621b4f7d-88fc-45a0-8c33-ede262410127 in Status: SUCCESS [ 1148.731200] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.731317] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.731594] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.731835] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.731905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.731974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.732139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.732222] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.732307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.732425] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.236176] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.738338] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 621b4f7d-88fc-45a0-8c33-ede262410127: rpc.has_security_group_logging(os_id): False [ 1149.760024] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.760024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.760024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.760239] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.760273] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.760550] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.761267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.761267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.761267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.761267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.761267] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 621b4f7d-88fc-45a0-8c33-ede262410127 is going to be created. [ 1149.831480] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.831702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.831769] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.831999] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.832369] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.845916] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 621b4f7d-88fc-45a0-8c33-ede262410127 in Status: IN_PROGRESS for 2s [ 1150.168402] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1150.168521] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1150.430831] env[65136]: INFO networking_nsxv3.common.synchronization [req-d2312cfa-9f00-4623-bee6-ff8eb70a4540 req-8a6b9070-155f-4a03-8ab5-b9ea22252b19 tempest-AttachVolumeTestJSON-333791645 tempest-AttachVolumeTestJSON-333791645-project-member] Enqueued Resource ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 with Priority: HIGHEST for action security_group_members [ 1150.431487] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 with Priority: HIGHEST for action security_group_members [ 1150.431487] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.431673] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.431673] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.431936] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.432045] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.432173] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.432173] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.432312] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.432425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.432508] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.940826] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.941240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.941240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.941308] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.941361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.941577] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.941684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.941750] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.941906] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.941984] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.942084] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 is going to be updated. [ 1150.970304] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.970482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.970578] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.970832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.970982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.980076] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 in Status: IN_PROGRESS for 2s [ 1151.859289] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 621b4f7d-88fc-45a0-8c33-ede262410127 in Status: SUCCESS [ 1151.859548] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.991623] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 in Status: SUCCESS [ 1152.992023] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331 deletion is rescheduled due to dependency. [ 1152.992023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.432611] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1155.432923] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1160.434049] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1160.434330] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1165.435700] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1165.436231] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1167.232879] env[65136]: INFO networking_nsxv3.common.synchronization [req-d08cf680-6e9d-4e8f-af54-637c0994c257 req-90006df2-3381-47a6-92e9-5aa1f8d32cd0 tempest-AttachVolumeNegativeTest-40195811 tempest-AttachVolumeNegativeTest-40195811-project-member] Enqueued Resource ID: 442ff863-0294-4912-9ccc-90fba7170dc2 with Priority: HIGHEST for action security_group_members [ 1167.233616] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 442ff863-0294-4912-9ccc-90fba7170dc2 with Priority: HIGHEST for action security_group_members [ 1167.234108] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-442ff863-0294-4912-9ccc-90fba7170dc2 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.234336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.234469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.234981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.234981] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.235302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.235302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.235441] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.235496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.235610] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('442ff863-0294-4912-9ccc-90fba7170dc2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.738889] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.740115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.740115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.740115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.740115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.740115] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.740115] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.740568] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.740568] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.740568] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.740568] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 442ff863-0294-4912-9ccc-90fba7170dc2 is going to be updated. [ 1167.786486] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.786726] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.786840] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.787169] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.787565] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.798768] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 442ff863-0294-4912-9ccc-90fba7170dc2 in Status: IN_PROGRESS for 2s [ 1169.026830] env[65136]: INFO networking_nsxv3.common.synchronization [req-fbdbbbd1-6db3-4922-beac-07b14971b330 req-bc3c47a6-dce6-4430-95a6-599bf500213f tempest-ServerActionsTestJSON-513195432 tempest-ServerActionsTestJSON-513195432-project-member] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 1169.027463] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 1169.027832] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.028207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.028207] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.028454] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.028665] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.028809] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.028912] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.029146] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.029312] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.029500] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.533022] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.533306] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.533393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.533707] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.533920] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.534222] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.534812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.534883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.535121] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.535231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.535373] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c is going to be updated. [ 1169.570664] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.570856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.570944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.571336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.571551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.582873] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: IN_PROGRESS for 2s [ 1169.809074] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 442ff863-0294-4912-9ccc-90fba7170dc2 in Status: SUCCESS [ 1169.809229] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 442ff863-0294-4912-9ccc-90fba7170dc2 deletion is rescheduled due to dependency. [ 1169.809271] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.593705] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: SUCCESS [ 1171.593999] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c deletion is rescheduled due to dependency. [ 1171.594063] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.028985] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1174.029427] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1178.317342] env[65136]: INFO networking_nsxv3.common.synchronization [req-36423832-d280-449e-87f7-2771bd1b3495 req-6424218f-0fa3-46d2-bc7c-1c14fb1b3f6f tempest-ServerActionsTestOtherA-1102352866 tempest-ServerActionsTestOtherA-1102352866-project-member] Enqueued Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_members [ 1178.317622] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_members [ 1178.318469] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.318469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.318469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.318469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.318682] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.318682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.318682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.318824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.318862] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.320108] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.668853] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.669061] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.669184] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.669456] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.669700] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.669849] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.669965] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.670197] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.670372] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.670573] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.670686] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1178.670796] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1178.670935] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1178.671134] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.671304] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1178.671448] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1178.696015] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1178.696264] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1178.696417] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1178.696543] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.696884] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.697079] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.697201] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.697519] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.697659] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.822576] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.822782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.822922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.823289] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.823475] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.823770] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.823935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.824045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.824316] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.824479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.824615] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 already deleted. [ 1178.824772] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.200358] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.200655] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.200937] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.201045] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.201186] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.201345] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4 not found, creating... [ 1179.201605] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.201765] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.201912] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.202151] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.202293] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.202575] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.202732] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.202849] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.203091] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.203241] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.203385] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4 is going to be created. [ 1179.224356] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.224579] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.224706] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.224967] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.225210] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.225442] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.941427] env[65136]: INFO networking_nsxv3.common.synchronization [req-36423832-d280-449e-87f7-2771bd1b3495 req-67a0091b-b0e5-4019-a510-5914a9224cea service nova] Enqueued Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_rules [ 1179.941697] env[65136]: INFO networking_nsxv3.common.synchronization [req-36423832-d280-449e-87f7-2771bd1b3495 req-67a0091b-b0e5-4019-a510-5914a9224cea service nova] Enqueued Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_members [ 1179.941879] env[65136]: INFO networking_nsxv3.common.synchronization [req-36423832-d280-449e-87f7-2771bd1b3495 req-67a0091b-b0e5-4019-a510-5914a9224cea service nova] Enqueued Resource ID: 9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4 with Priority: HIGHEST for action port [ 1179.942322] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_rules [ 1179.942459] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_members [ 1179.942557] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4 with Priority: HIGHEST for action port [ 1179.943130] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.943304] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.943378] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.943637] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.943724] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.944762] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.944887] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.944957] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.945147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.945341] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.945469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.945516] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.945657] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.945690] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.945787] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.946579] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.946688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.946755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.946903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.947169] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.449334] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.449334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.449867] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.451382] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4 with status ACTIVE [ 1180.451562] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.451770] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.451770] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.452026] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.452240] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.452364] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.452463] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.452517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.452686] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.452763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.452949] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.453148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.453148] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.453356] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.453356] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.453455] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4 is going to be updated. [ 1180.477401] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.477663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.477708] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.477946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.478127] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.478396] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9561b710-bfc9-47fa-bc48-0e9cd8aa4fb4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.568753] env[65136]: INFO networking_nsxv3.common.synchronization [req-2932346f-7b91-4d32-9d07-b7435e847900 req-40f021e8-766f-44a5-8a85-30b3f21f6a36 tempest-ServerActionsTestJSON-513195432 tempest-ServerActionsTestJSON-513195432-project-member] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 1180.569329] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 1180.569644] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.569767] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.569829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.570045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.570370] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.570370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.570370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.570512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.570589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.570662] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.874682] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-360 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.874885] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.875018] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.875320] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.875534] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.875688] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.875805] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.876018] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.876190] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.876411] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1180.876525] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1180.876633] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1180.876741] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1180.876852] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1180.876956] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1180.877108] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1180.895282] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1180.895537] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1180.895678] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1180.895848] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-360" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.896217] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-08ce3357-c80a-405f-a12e-57df0b267aee taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.896398] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-08ce3357-c80a-405f-a12e-57df0b267aee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.896521] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-08ce3357-c80a-405f-a12e-57df0b267aee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.896827] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-08ce3357-c80a-405f-a12e-57df0b267aee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.896968] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08ce3357-c80a-405f-a12e-57df0b267aee',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.955825] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.072522] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.072704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.072747] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.072960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.073110] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.073303] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.073406] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.073470] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.073628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.073705] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.073793] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c is going to be updated. [ 1181.102048] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.102250] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.102319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.102520] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.102672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.113675] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: IN_PROGRESS for 2s [ 1181.398818] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.399054] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.399184] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.399550] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.399708] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.399866] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 08ce3357-c80a-405f-a12e-57df0b267aee not found, creating... [ 1181.400131] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.400289] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.400407] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.400618] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.400752] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.401090] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.401261] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.401380] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.401584] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.401716] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.401854] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 08ce3357-c80a-405f-a12e-57df0b267aee is going to be created. [ 1181.423365] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.423573] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.423691] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.423956] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.424224] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.424431] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-08ce3357-c80a-405f-a12e-57df0b267aee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.458351] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.458607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.458607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.458794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.458869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.458973] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 is going to be created. [ 1181.519114] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.519331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.519331] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.519608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.519814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.530626] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 in Status: UNINITIALIZED for 2s [ 1182.161021] env[65136]: INFO networking_nsxv3.common.synchronization [req-2932346f-7b91-4d32-9d07-b7435e847900 req-df5f221a-a14b-4df7-9efa-cd840853a189 service nova] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_rules [ 1182.161329] env[65136]: INFO networking_nsxv3.common.synchronization [req-2932346f-7b91-4d32-9d07-b7435e847900 req-df5f221a-a14b-4df7-9efa-cd840853a189 service nova] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 1182.161365] env[65136]: INFO networking_nsxv3.common.synchronization [req-2932346f-7b91-4d32-9d07-b7435e847900 req-df5f221a-a14b-4df7-9efa-cd840853a189 service nova] Enqueued Resource ID: 08ce3357-c80a-405f-a12e-57df0b267aee with Priority: HIGHEST for action port [ 1182.161881] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_rules [ 1182.162037] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 1182.162145] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08ce3357-c80a-405f-a12e-57df0b267aee with Priority: HIGHEST for action port [ 1182.162423] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.162543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.162610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.162927] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.162927] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.163750] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.163848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.164160] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-08ce3357-c80a-405f-a12e-57df0b267aee taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.164249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08ce3357-c80a-405f-a12e-57df0b267aee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.165016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08ce3357-c80a-405f-a12e-57df0b267aee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.165016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08ce3357-c80a-405f-a12e-57df0b267aee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.165016] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08ce3357-c80a-405f-a12e-57df0b267aee',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.666207] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.666426] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.666713] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08ce3357-c80a-405f-a12e-57df0b267aee with status ACTIVE [ 1182.666946] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.667149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.667226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.667546] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.667698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.667903] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.668042] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.668111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.668308] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.668413] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.668626] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.668764] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.668849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.669028] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.669139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.669250] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08ce3357-c80a-405f-a12e-57df0b267aee is going to be updated. [ 1182.691357] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.691582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.691582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.691789] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.691930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.692107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08ce3357-c80a-405f-a12e-57df0b267aee" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.125934] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: SUCCESS [ 1183.126174] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c deletion is rescheduled due to dependency. [ 1183.126302] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.126478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.126704] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.126907] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.127040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.127111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.127278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.127361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.127461] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.541506] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 in Status: SUCCESS [ 1183.541813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.541924] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.542338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.542489] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.542664] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.542751] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.542972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.543135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.543286] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.543426] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.629339] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.046081] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.046081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.046081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.046446] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.046579] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.046721] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.046845] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.047045] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.047138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.047270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.047456] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.047558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.047619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.047805] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.047954] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.048081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.048169] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.048344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.048424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.048507] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.048602] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.132776] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.550599] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46: rpc.has_security_group_logging(os_id): False [ 1184.569816] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.570048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.570048] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.570272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.570360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.570570] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.570669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.570733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.570880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.570954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.571159] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.571253] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.571312] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.571448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.571518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.571696] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.571785] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.571845] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.571977] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.572060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.572143] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 is going to be created. [ 1184.635342] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.635342] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.635487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.635693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.635778] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.635878] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c is going to be updated. [ 1184.640481] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.640619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.640836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.640902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.641035] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.659375] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 in Status: IN_PROGRESS for 2s [ 1184.722963] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.722963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.722963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.722963] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.723330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.735380] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: IN_PROGRESS for 2s [ 1185.999229] env[65136]: INFO networking_nsxv3.common.synchronization [req-a676c7c7-e394-4e1a-9dcd-7db9a898f1f1 req-e32da76d-24d4-4a2c-bf41-0ce08586ce78 tempest-AttachVolumeShelveTestJSON-1302323664 tempest-AttachVolumeShelveTestJSON-1302323664-project-member] Enqueued Resource ID: 34781a01-2f7c-494e-a20f-c65d97596e05 with Priority: HIGHEST for action security_group_members [ 1185.999898] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34781a01-2f7c-494e-a20f-c65d97596e05 with Priority: HIGHEST for action security_group_members [ 1186.000292] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-34781a01-2f7c-494e-a20f-c65d97596e05 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.000466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.000570] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.001627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.001627] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.001627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.001627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.001627] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.002052] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.002052] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34781a01-2f7c-494e-a20f-c65d97596e05',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.315909] env[65136]: INFO networking_nsxv3.common.synchronization [req-f708cb39-055c-4df5-bda0-b6814793cbd8 req-f904ed34-e008-4e27-9681-fab241fcfa23 tempest-AttachInterfacesUnderV243Test-374684262 tempest-AttachInterfacesUnderV243Test-374684262-project-member] Enqueued Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_members [ 1186.316651] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_members [ 1186.317169] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-621b4f7d-88fc-45a0-8c33-ede262410127 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.318223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.318223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.318223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.318223] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.318223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.318223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.318223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.318614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.318614] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.347220] env[65136]: INFO networking_nsxv3.common.synchronization [req-f708cb39-055c-4df5-bda0-b6814793cbd8 req-f904ed34-e008-4e27-9681-fab241fcfa23 tempest-AttachInterfacesUnderV243Test-374684262 tempest-AttachInterfacesUnderV243Test-374684262-project-member] Enqueued Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_rules [ 1186.347220] env[65136]: INFO networking_nsxv3.common.synchronization [req-f708cb39-055c-4df5-bda0-b6814793cbd8 req-f904ed34-e008-4e27-9681-fab241fcfa23 tempest-AttachInterfacesUnderV243Test-374684262 tempest-AttachInterfacesUnderV243Test-374684262-project-member] Enqueued Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_members [ 1186.347220] env[65136]: INFO networking_nsxv3.common.synchronization [req-f708cb39-055c-4df5-bda0-b6814793cbd8 req-f904ed34-e008-4e27-9681-fab241fcfa23 tempest-AttachInterfacesUnderV243Test-374684262 tempest-AttachInterfacesUnderV243Test-374684262-project-member] Enqueued Resource ID: 13e99389-845f-42e3-aae4-c16c37bb3bc8 with Priority: HIGHEST for action port [ 1186.347905] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_rules [ 1186.348237] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_members [ 1186.348464] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e99389-845f-42e3-aae4-c16c37bb3bc8 with Priority: HIGHEST for action port [ 1186.348916] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-621b4f7d-88fc-45a0-8c33-ede262410127 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.349197] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.349356] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.351290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.351498] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.356468] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-621b4f7d-88fc-45a0-8c33-ede262410127 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.356468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.356468] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-13e99389-845f-42e3-aae4-c16c37bb3bc8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.356651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.356651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.357316] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.357316] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13e99389-845f-42e3-aae4-c16c37bb3bc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.506367] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.506590] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.506644] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.506862] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.506965] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.507180] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.507277] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.507344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.507500] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.507575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.507662] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34781a01-2f7c-494e-a20f-c65d97596e05 is going to be updated. [ 1186.541157] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.541359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.541447] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.541703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.541923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.551738] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34781a01-2f7c-494e-a20f-c65d97596e05 in Status: IN_PROGRESS for 2s [ 1186.675930] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 in Status: SUCCESS [ 1186.676226] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.746159] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: SUCCESS [ 1186.746600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.746600] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.746756] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.746948] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.747073] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.747142] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.747295] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.747376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.747461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.747550] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.819947] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.858907] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-621b4f7d-88fc-45a0-8c33-ede262410127 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.859076] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.862452] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13e99389-845f-42e3-aae4-c16c37bb3bc8 with status ACTIVE [ 1186.862692] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.862832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.862921] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.863181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.863320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.863596] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.863923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.863923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.863923] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.864088] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.864168] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.864301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.864387] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.864542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.864619] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.864705] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13e99389-845f-42e3-aae4-c16c37bb3bc8 is going to be updated. [ 1186.889605] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.889605] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.889605] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.889605] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.889931] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.889931] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.249645] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.322449] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.752169] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 341154f1-9b0b-43bc-8e74-163cf220f74c: rpc.has_security_group_logging(os_id): False [ 1187.772702] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.772853] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.772918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.773303] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.773440] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.773708] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.773812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.773879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.774046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.774124] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.774232] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c is going to be updated. [ 1187.825326] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.825592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.825693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.825967] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.826085] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.826194] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 621b4f7d-88fc-45a0-8c33-ede262410127 is going to be updated. [ 1187.841155] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.841312] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.841357] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.841563] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.841705] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.860418] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: IN_PROGRESS for 2s [ 1187.865357] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.865585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.865585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.865712] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.865840] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.877592] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 621b4f7d-88fc-45a0-8c33-ede262410127 in Status: IN_PROGRESS for 2s [ 1188.562029] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34781a01-2f7c-494e-a20f-c65d97596e05 in Status: SUCCESS [ 1188.562332] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34781a01-2f7c-494e-a20f-c65d97596e05 deletion is rescheduled due to dependency. [ 1188.562404] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.848665] env[65136]: INFO networking_nsxv3.common.synchronization [req-e00979c5-c2b5-4d6c-8d13-ba7ac6cefd73 req-32ef7b1b-04b2-4ceb-9c19-2cfb01508ee6 tempest-AttachInterfacesUnderV243Test-374684262 tempest-AttachInterfacesUnderV243Test-374684262-project-member] Enqueued Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_members [ 1189.849367] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_members [ 1189.849592] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-621b4f7d-88fc-45a0-8c33-ede262410127 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.849675] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.865656] env[65136]: INFO networking_nsxv3.common.synchronization [req-e00979c5-c2b5-4d6c-8d13-ba7ac6cefd73 req-32ef7b1b-04b2-4ceb-9c19-2cfb01508ee6 tempest-AttachInterfacesUnderV243Test-374684262 tempest-AttachInterfacesUnderV243Test-374684262-project-member] Enqueued Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_rules [ 1189.865838] env[65136]: INFO networking_nsxv3.common.synchronization [req-e00979c5-c2b5-4d6c-8d13-ba7ac6cefd73 req-32ef7b1b-04b2-4ceb-9c19-2cfb01508ee6 tempest-AttachInterfacesUnderV243Test-374684262 tempest-AttachInterfacesUnderV243Test-374684262-project-member] Enqueued Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_members [ 1189.865977] env[65136]: INFO networking_nsxv3.common.synchronization [req-e00979c5-c2b5-4d6c-8d13-ba7ac6cefd73 req-32ef7b1b-04b2-4ceb-9c19-2cfb01508ee6 tempest-AttachInterfacesUnderV243Test-374684262 tempest-AttachInterfacesUnderV243Test-374684262-project-member] Enqueued Resource ID: 13e99389-845f-42e3-aae4-c16c37bb3bc8 with Priority: HIGHEST for action port [ 1189.866734] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_rules [ 1189.866923] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_members [ 1189.867202] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e99389-845f-42e3-aae4-c16c37bb3bc8 with Priority: HIGHEST for action port [ 1189.867472] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-621b4f7d-88fc-45a0-8c33-ede262410127 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.867536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.867766] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-621b4f7d-88fc-45a0-8c33-ede262410127 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.867880] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.868113] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-13e99389-845f-42e3-aae4-c16c37bb3bc8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.868223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.868290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.868485] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.868567] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13e99389-845f-42e3-aae4-c16c37bb3bc8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.880510] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: SUCCESS [ 1189.881368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.886586] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 621b4f7d-88fc-45a0-8c33-ede262410127 in Status: SUCCESS [ 1189.886814] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.887247] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.887458] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.887641] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.887795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.887883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.888061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.888143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.888238] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.372159] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13e99389-845f-42e3-aae4-c16c37bb3bc8 with status ACTIVE [ 1190.372602] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.372698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.372776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.373027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.373130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.373550] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.373747] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.373849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.374190] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.374366] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.374683] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.374851] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.374978] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.375225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.375376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.375530] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13e99389-845f-42e3-aae4-c16c37bb3bc8 is going to be updated. [ 1190.390112] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.400234] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.400386] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.400460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.400656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.400792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.400969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13e99389-845f-42e3-aae4-c16c37bb3bc8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.891986] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.394735] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.394922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.394962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.395220] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.395315] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.395475] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 621b4f7d-88fc-45a0-8c33-ede262410127 is going to be updated. [ 1191.426427] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.426569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.426640] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.427079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.427079] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.435670] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 621b4f7d-88fc-45a0-8c33-ede262410127 in Status: IN_PROGRESS for 2s [ 1193.450272] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 621b4f7d-88fc-45a0-8c33-ede262410127 in Status: SUCCESS [ 1193.450711] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.450936] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.451250] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.451506] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.451670] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.451752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.451902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.451989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.452177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.452266] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.453337] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.453513] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.453689] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.453797] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.453856] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.454012] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.454095] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.454184] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.563600] env[65136]: INFO networking_nsxv3.common.synchronization [req-e5210faf-8a3d-4212-9b28-b67f32f4fb09 req-560330f4-c451-4e8f-8890-96b46c9ea39d tempest-AttachInterfacesUnderV243Test-374684262 tempest-AttachInterfacesUnderV243Test-374684262-project-member] Enqueued Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_members [ 1193.564387] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 621b4f7d-88fc-45a0-8c33-ede262410127 with Priority: HIGHEST for action security_group_members [ 1193.564753] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-621b4f7d-88fc-45a0-8c33-ede262410127 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.564936] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.957103] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.957391] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.459807] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 621b4f7d-88fc-45a0-8c33-ede262410127: rpc.has_security_group_logging(os_id): False [ 1194.461166] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.479814] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.479990] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.480164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.480349] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.480457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.480729] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.480875] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.480935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.481138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.481225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.481317] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 621b4f7d-88fc-45a0-8c33-ede262410127 is going to be updated. [ 1194.553619] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.553879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.553879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.554084] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.554225] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.569619] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 621b4f7d-88fc-45a0-8c33-ede262410127 in Status: IN_PROGRESS for 2s [ 1194.964148] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.964397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.964397] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.964628] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.964726] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.964823] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 621b4f7d-88fc-45a0-8c33-ede262410127 is going to be updated. [ 1194.993426] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.993663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.993792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.994090] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.994294] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.004080] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 621b4f7d-88fc-45a0-8c33-ede262410127 in Status: IN_PROGRESS for 2s [ 1196.587867] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 621b4f7d-88fc-45a0-8c33-ede262410127 in Status: SUCCESS [ 1196.588301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.588365] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.588607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.588698] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.015296] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 621b4f7d-88fc-45a0-8c33-ede262410127 in Status: SUCCESS [ 1197.015516] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.015725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.015944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.016148] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.016270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.016347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.016558] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.016646] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.016748] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.108178] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.108383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.108383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.108608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.108702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.108801] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 621b4f7d-88fc-45a0-8c33-ede262410127 is going to be deleted. [ 1197.181431] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.181678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.181678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.181849] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.181941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.182086] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.519789] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.519953] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.520059] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.520368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.520501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.520746] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.520898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.521075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.521174] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.521272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.521386] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 621b4f7d-88fc-45a0-8c33-ede262410127 is going to be deleted. [ 1197.556556] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.556720] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.556763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.556969] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.557074] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.557175] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.557334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.557483] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.557639] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.557735] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.557798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.557935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.558022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.558113] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('621b4f7d-88fc-45a0-8c33-ede262410127',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.061101] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.061531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.061531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.061641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.061701] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.061921] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.062066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.062133] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.062301] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.062382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.062471] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 621b4f7d-88fc-45a0-8c33-ede262410127 already deleted. [ 1198.062643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-621b4f7d-88fc-45a0-8c33-ede262410127" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.565762] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1198.565960] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1201.485431] env[65136]: INFO networking_nsxv3.common.synchronization [None req-f18c803e-2488-45c4-a9d5-b491fa56652a None None] Enqueued Resource ID: b590d3d7-a067-4b37-8810-f5bf9b63b6af with Priority: HIGHEST for action port [ 1201.486115] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b590d3d7-a067-4b37-8810-f5bf9b63b6af with Priority: HIGHEST for action port [ 1201.486758] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-b590d3d7-a067-4b37-8810-f5bf9b63b6af taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.487149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b590d3d7-a067-4b37-8810-f5bf9b63b6af" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.487149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b590d3d7-a067-4b37-8810-f5bf9b63b6af" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.487347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b590d3d7-a067-4b37-8810-f5bf9b63b6af" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.487487] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b590d3d7-a067-4b37-8810-f5bf9b63b6af',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.990486] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b590d3d7-a067-4b37-8810-f5bf9b63b6af [ 1201.990603] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.990759] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.990813] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.991039] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.991139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.991251] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b590d3d7-a067-4b37-8810-f5bf9b63b6af already deleted. [ 1201.991338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b590d3d7-a067-4b37-8810-f5bf9b63b6af" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.626340] env[65136]: INFO networking_nsxv3.common.synchronization [None req-44fdc17e-69e7-4f8c-8b34-1a13919431d3 None None] Enqueued Resource ID: 5cc21552-c576-4465-88d3-e699f1ed5501 with Priority: HIGHEST for action port [ 1203.626618] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cc21552-c576-4465-88d3-e699f1ed5501 with Priority: HIGHEST for action port [ 1203.626873] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cc21552-c576-4465-88d3-e699f1ed5501 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.627395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cc21552-c576-4465-88d3-e699f1ed5501" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.627395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cc21552-c576-4465-88d3-e699f1ed5501" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.627395] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cc21552-c576-4465-88d3-e699f1ed5501" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.627395] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cc21552-c576-4465-88d3-e699f1ed5501',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.130935] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5cc21552-c576-4465-88d3-e699f1ed5501 [ 1204.130935] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.130935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.130935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.130935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.130935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.130935] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5cc21552-c576-4465-88d3-e699f1ed5501 already deleted. [ 1204.130935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cc21552-c576-4465-88d3-e699f1ed5501" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.289067] env[65136]: INFO networking_nsxv3.common.synchronization [req-1b2fe582-126b-49e9-af7f-492f83e94e9c req-a150b3be-4388-47ec-8128-a0a0f10d437e tempest-ServerActionsTestOtherA-1102352866 tempest-ServerActionsTestOtherA-1102352866-project-member] Enqueued Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_members [ 1205.289937] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_members [ 1205.289937] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.290120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.290120] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.290290] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.290441] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.290544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.290603] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.290893] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.291017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.291117] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.793494] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.793758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.793758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.793970] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.794074] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.794281] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.794382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.794495] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.794669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.794748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.794850] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 is going to be updated. [ 1205.828601] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.828601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.828601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.828889] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.829023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.837559] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 in Status: IN_PROGRESS for 2s [ 1207.069286] env[65136]: INFO networking_nsxv3.common.synchronization [req-4492183d-dc6b-4566-a071-1cd94374b315 req-ae382421-b456-4d6d-9abc-323e492f6b09 tempest-ServerMetadataTestJSON-441273325 tempest-ServerMetadataTestJSON-441273325-project-member] Enqueued Resource ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 with Priority: HIGHEST for action security_group_members [ 1207.069829] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 with Priority: HIGHEST for action security_group_members [ 1207.070145] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.070274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.070334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.070581] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.070735] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.070832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.070892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.071055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.071143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.071236] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.377068] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-394 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.377285] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-394" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.377411] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-394" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.377746] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-394" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.378019] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.378178] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.378294] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.378505] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.378707] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.378864] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1207.378971] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1207.379087] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1207.379191] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1207.379301] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1207.379406] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1207.379535] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1207.400148] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1207.400347] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1207.400502] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1207.400691] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-394" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.401017] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-b549abfd-a21c-454a-93dd-4daea4e85819 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.401208] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-b549abfd-a21c-454a-93dd-4daea4e85819" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.401315] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-b549abfd-a21c-454a-93dd-4daea4e85819" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.401729] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-b549abfd-a21c-454a-93dd-4daea4e85819" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.401868] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b549abfd-a21c-454a-93dd-4daea4e85819',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.573200] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.573382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.573382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.573749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.573877] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.574154] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.574291] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.574383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.574632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.574754] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.574792] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 already deleted. [ 1207.574922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.847913] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 in Status: SUCCESS [ 1207.848139] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 deletion is rescheduled due to dependency. [ 1207.848262] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.904828] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.905088] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.905258] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.905570] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.905873] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.906100] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port b549abfd-a21c-454a-93dd-4daea4e85819 not found, creating... [ 1207.906462] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.906662] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.906811] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.907083] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.907244] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.907590] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.907792] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.907945] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.908211] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.908386] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.908613] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: b549abfd-a21c-454a-93dd-4daea4e85819 is going to be created. [ 1207.931746] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.931982] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.932096] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.932378] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.932608] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.932848] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-b549abfd-a21c-454a-93dd-4daea4e85819" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.647012] env[65136]: INFO networking_nsxv3.common.synchronization [req-4492183d-dc6b-4566-a071-1cd94374b315 req-140de2b4-e754-4e2d-8f27-44be0c6fca95 service nova] Enqueued Resource ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 with Priority: HIGHEST for action security_group_rules [ 1208.647012] env[65136]: INFO networking_nsxv3.common.synchronization [req-4492183d-dc6b-4566-a071-1cd94374b315 req-140de2b4-e754-4e2d-8f27-44be0c6fca95 service nova] Enqueued Resource ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 with Priority: HIGHEST for action security_group_members [ 1208.647012] env[65136]: INFO networking_nsxv3.common.synchronization [req-4492183d-dc6b-4566-a071-1cd94374b315 req-140de2b4-e754-4e2d-8f27-44be0c6fca95 service nova] Enqueued Resource ID: b549abfd-a21c-454a-93dd-4daea4e85819 with Priority: HIGHEST for action port [ 1208.647833] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 with Priority: HIGHEST for action security_group_rules [ 1208.647833] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 with Priority: HIGHEST for action security_group_members [ 1208.647833] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b549abfd-a21c-454a-93dd-4daea4e85819 with Priority: HIGHEST for action port [ 1208.647833] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.647982] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.648035] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.648382] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.648470] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.650068] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.650205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.650275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.650487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.650733] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.650842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.650917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.651829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.651829] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.651829] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.652974] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-b549abfd-a21c-454a-93dd-4daea4e85819 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.652974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b549abfd-a21c-454a-93dd-4daea4e85819" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.653145] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b549abfd-a21c-454a-93dd-4daea4e85819" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.653213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b549abfd-a21c-454a-93dd-4daea4e85819" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.653287] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b549abfd-a21c-454a-93dd-4daea4e85819',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.153669] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.155455] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.155551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.155724] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b549abfd-a21c-454a-93dd-4daea4e85819 with status ACTIVE [ 1209.155942] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.156288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.156353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.156586] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.156872] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.156872] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.156946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.156974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.157155] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.157715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.157978] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.158217] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.158278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.158375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.158460] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.158547] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b549abfd-a21c-454a-93dd-4daea4e85819 is going to be updated. [ 1209.184825] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.184825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.184825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.185090] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.185149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.185318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b549abfd-a21c-454a-93dd-4daea4e85819" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.415710] env[65136]: INFO networking_nsxv3.common.synchronization [None req-91295d78-6f96-4518-927f-ed05d6fccbc0 tempest-ServerActionsTestOtherA-1102352866 tempest-ServerActionsTestOtherA-1102352866-project-member] Enqueued Resource ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 with Priority: HIGHEST for action security_group_rules [ 1209.416249] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 with Priority: HIGHEST for action security_group_rules [ 1209.416559] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-140e14c8-58c7-45d7-b4d2-76922c1f6b26 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.416698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.416785] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.417082] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.417167] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('140e14c8-58c7-45d7-b4d2-76922c1f6b26',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.512943] env[65136]: INFO networking_nsxv3.common.synchronization [None req-8fa2c559-5ac1-4714-bea0-615a64f3a0dc tempest-ServerActionsTestOtherA-1102352866 tempest-ServerActionsTestOtherA-1102352866-project-member] Enqueued Resource ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 with Priority: HIGHEST for action security_group_rules [ 1209.513387] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 with Priority: HIGHEST for action security_group_rules [ 1209.513952] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-140e14c8-58c7-45d7-b4d2-76922c1f6b26 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.513952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.661231] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.946186] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.946344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.946393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.946606] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.946696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.946826] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 already deleted. [ 1209.946874] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.947024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.947177] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.947255] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('140e14c8-58c7-45d7-b4d2-76922c1f6b26',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.163787] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.163955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.164046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.164271] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.164362] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.164464] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 is going to be created. [ 1210.191265] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.191445] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.191490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.191698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.191858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.203043] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 in Status: UNINITIALIZED for 2s [ 1210.469450] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.469665] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.469665] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.469919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.470017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.470131] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 already deleted. [ 1210.470224] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.213789] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 in Status: SUCCESS [ 1212.214135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.214347] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.214607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.214809] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.214928] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.214995] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.215164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.215274] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.215421] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.215554] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.717738] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.718061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.718061] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.719384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.719384] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.719384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.719384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.719384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.719384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.719384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.719384] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.719384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.719384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.719872] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.719872] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.719872] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.719872] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.720040] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.720145] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.720256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.720367] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.222790] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6: rpc.has_security_group_logging(os_id): False [ 1213.242333] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.242449] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.242537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.243275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.243275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.243275] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.243275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.243275] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.243525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.243525] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.243725] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.243817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.243877] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.244030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.244103] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.244459] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.244459] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.244573] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.244726] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.244726] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.244857] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 is going to be created. [ 1213.316177] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.316465] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.316465] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.316673] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.316795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.330516] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 in Status: IN_PROGRESS for 2s [ 1214.514504] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1214.514504] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1214.811270] env[65136]: INFO networking_nsxv3.common.synchronization [req-f82fd43b-19b6-42ee-9851-060145630048 req-02da6bb3-b7fa-4353-9b56-677512b117e2 tempest-ServerActionsTestOtherA-1102352866 tempest-ServerActionsTestOtherA-1102352866-project-member] Enqueued Resource ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 with Priority: HIGHEST for action security_group_members [ 1214.811838] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 with Priority: HIGHEST for action security_group_members [ 1214.812220] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-140e14c8-58c7-45d7-b4d2-76922c1f6b26 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.812284] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.812319] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.812588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.812740] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.812834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.812890] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.813051] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.813136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.813230] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('140e14c8-58c7-45d7-b4d2-76922c1f6b26',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.091516] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.091745] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.091873] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.092203] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.092556] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.092723] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.092841] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.093156] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.093373] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.093723] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1215.093908] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1215.094081] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1215.094202] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1215.094315] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1215.094422] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1215.094553] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1215.113804] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1215.113998] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1215.114109] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1215.114326] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.114622] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-09acdca7-71ba-42ec-9f47-0db13c420aa0 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.114810] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-09acdca7-71ba-42ec-9f47-0db13c420aa0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.114891] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-09acdca7-71ba-42ec-9f47-0db13c420aa0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.115170] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-09acdca7-71ba-42ec-9f47-0db13c420aa0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.115310] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09acdca7-71ba-42ec-9f47-0db13c420aa0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.315641] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.315915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.315971] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.316232] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.316343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.316530] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.316638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.316697] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.316835] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.316897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.316982] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 already deleted. [ 1215.317073] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.341728] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 in Status: SUCCESS [ 1215.341956] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.617774] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.618145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.618145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.618372] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.618522] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.618676] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 09acdca7-71ba-42ec-9f47-0db13c420aa0 not found, creating... [ 1215.618933] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.619110] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.619228] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.619445] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.619580] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.619856] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.620030] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.620209] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.620352] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.620482] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.620621] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 09acdca7-71ba-42ec-9f47-0db13c420aa0 is going to be created. [ 1215.640878] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.641138] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.641277] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.641478] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.641702] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.641923] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-09acdca7-71ba-42ec-9f47-0db13c420aa0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.330858] env[65136]: INFO networking_nsxv3.common.synchronization [req-f82fd43b-19b6-42ee-9851-060145630048 req-9bed9e9c-f5cf-453e-a460-6d9116e246ff service nova] Enqueued Resource ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 with Priority: HIGHEST for action security_group_rules [ 1216.331051] env[65136]: INFO networking_nsxv3.common.synchronization [req-f82fd43b-19b6-42ee-9851-060145630048 req-9bed9e9c-f5cf-453e-a460-6d9116e246ff service nova] Enqueued Resource ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 with Priority: HIGHEST for action security_group_members [ 1216.331202] env[65136]: INFO networking_nsxv3.common.synchronization [req-f82fd43b-19b6-42ee-9851-060145630048 req-9bed9e9c-f5cf-453e-a460-6d9116e246ff service nova] Enqueued Resource ID: 09acdca7-71ba-42ec-9f47-0db13c420aa0 with Priority: HIGHEST for action port [ 1216.331787] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 with Priority: HIGHEST for action security_group_rules [ 1216.331935] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 with Priority: HIGHEST for action security_group_members [ 1216.332410] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09acdca7-71ba-42ec-9f47-0db13c420aa0 with Priority: HIGHEST for action port [ 1216.332732] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-140e14c8-58c7-45d7-b4d2-76922c1f6b26 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.332862] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.332930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.333146] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.333259] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('140e14c8-58c7-45d7-b4d2-76922c1f6b26',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.335080] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-140e14c8-58c7-45d7-b4d2-76922c1f6b26 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.335320] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.335396] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.336033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.336033] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.336033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.336033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.336033] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.336284] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.336610] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('140e14c8-58c7-45d7-b4d2-76922c1f6b26',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.337506] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-09acdca7-71ba-42ec-9f47-0db13c420aa0 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.337612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09acdca7-71ba-42ec-9f47-0db13c420aa0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.337665] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09acdca7-71ba-42ec-9f47-0db13c420aa0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.337935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09acdca7-71ba-42ec-9f47-0db13c420aa0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.338028] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09acdca7-71ba-42ec-9f47-0db13c420aa0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.836800] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-140e14c8-58c7-45d7-b4d2-76922c1f6b26 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.836800] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.839060] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('140e14c8-58c7-45d7-b4d2-76922c1f6b26',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.839934] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09acdca7-71ba-42ec-9f47-0db13c420aa0 with status ACTIVE [ 1216.840145] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.840266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.840333] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.840530] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.840616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.840789] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.840877] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.840941] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.841102] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.841192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.841521] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.841521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.841521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.841672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.841762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.841835] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09acdca7-71ba-42ec-9f47-0db13c420aa0 is going to be updated. [ 1216.867587] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.867759] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.867810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.868016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.868154] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.868312] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09acdca7-71ba-42ec-9f47-0db13c420aa0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.345041] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('140e14c8-58c7-45d7-b4d2-76922c1f6b26',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.847608] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.847918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.847918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.848163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.848259] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.848383] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 is going to be created. [ 1217.875843] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.876057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.876057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.876263] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.876422] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.886595] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 in Status: UNINITIALIZED for 2s [ 1219.897861] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 in Status: SUCCESS [ 1219.898146] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.898246] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.898456] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.898651] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.898765] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.898836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.898986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.899075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.899157] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.899245] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('140e14c8-58c7-45d7-b4d2-76922c1f6b26',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.016486] env[65136]: INFO networking_nsxv3.common.synchronization [req-8bce3b58-36f1-4a9c-86e7-66b5b5e4f6d6 req-964cad02-a404-4fa1-b2bc-882ae38e3f3a tempest-ServerMetadataTestJSON-441273325 tempest-ServerMetadataTestJSON-441273325-project-member] Enqueued Resource ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 with Priority: HIGHEST for action security_group_members [ 1220.017075] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 with Priority: HIGHEST for action security_group_members [ 1220.017351] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.017468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.017535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.017725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.017878] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.017972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.018238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.018238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.018328] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.018361] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.401303] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('140e14c8-58c7-45d7-b4d2-76922c1f6b26',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.520212] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.520432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.520432] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.520672] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.520806] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.521060] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.521203] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.521315] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.521433] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.521563] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.521642] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 is going to be updated. [ 1220.550076] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.550322] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.550322] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.550505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.550648] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.560507] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 in Status: IN_PROGRESS for 2s [ 1220.904096] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 140e14c8-58c7-45d7-b4d2-76922c1f6b26: rpc.has_security_group_logging(os_id): False [ 1220.921311] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.921490] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.921533] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.921732] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.921817] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.922089] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.922191] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.922256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.922412] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.922494] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.922581] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 is going to be created. [ 1220.976830] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.977050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.977050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.977233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.977405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.989631] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 in Status: IN_PROGRESS for 2s [ 1222.571128] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 in Status: SUCCESS [ 1222.571481] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6 deletion is rescheduled due to dependency. [ 1222.571481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.011165] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 in Status: SUCCESS [ 1223.011403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.017986] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1225.018361] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1230.018997] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1230.019375] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1235.020182] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1235.020570] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1240.021058] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1240.021436] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1244.132937] env[65136]: INFO networking_nsxv3.common.synchronization [req-86218e4c-65fb-4f8f-8ac4-6a141af2805a req-a22b9f40-cbeb-463f-a055-8c88341b9d23 tempest-ServerActionsTestJSON-513195432 tempest-ServerActionsTestJSON-513195432-project-member] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 1244.133372] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGHEST for action security_group_members [ 1244.133372] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.133523] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.133579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.133745] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.133916] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.134031] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.134147] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.134270] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.134387] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.134691] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.636474] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.636720] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.636720] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.636925] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.637024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.637227] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.637318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.637393] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.637531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.637607] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.637691] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c is going to be updated. [ 1244.666126] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.666394] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.666394] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.666616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.666678] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.674593] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: IN_PROGRESS for 2s [ 1246.685635] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 341154f1-9b0b-43bc-8e74-163cf220f74c in Status: SUCCESS [ 1246.685635] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c deletion is rescheduled due to dependency. [ 1246.685635] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.134160] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1249.134503] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1251.975111] env[65136]: INFO networking_nsxv3.common.synchronization [None req-25403f8c-5fa7-4abb-8f13-69b8f15b8efe None None] Enqueued Resource ID: 035b1ae8-2392-42b6-8c6b-c891ccded3e2 with Priority: HIGHEST for action port [ 1251.975731] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 035b1ae8-2392-42b6-8c6b-c891ccded3e2 with Priority: HIGHEST for action port [ 1251.976066] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-035b1ae8-2392-42b6-8c6b-c891ccded3e2 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.976260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-035b1ae8-2392-42b6-8c6b-c891ccded3e2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.976322] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-035b1ae8-2392-42b6-8c6b-c891ccded3e2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.976958] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-035b1ae8-2392-42b6-8c6b-c891ccded3e2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.976958] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('035b1ae8-2392-42b6-8c6b-c891ccded3e2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.480414] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 035b1ae8-2392-42b6-8c6b-c891ccded3e2 [ 1252.480689] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.480831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.480892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.481238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.481337] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.481454] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:035b1ae8-2392-42b6-8c6b-c891ccded3e2 already deleted. [ 1252.481531] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-035b1ae8-2392-42b6-8c6b-c891ccded3e2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.580437] env[65136]: INFO networking_nsxv3.common.synchronization [None req-35cadf52-6e3d-496d-97b4-6de2e56160c7 tempest-ServerActionsTestOtherB-2006431978 tempest-ServerActionsTestOtherB-2006431978-project-member] Enqueued Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_rules [ 1252.580973] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_rules [ 1252.581289] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.581418] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.581482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.581736] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.581820] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.666677] env[65136]: INFO networking_nsxv3.common.synchronization [None req-4cfb241d-7a1a-44f9-9065-b5862c2fe898 tempest-ServerActionsTestOtherB-2006431978 tempest-ServerActionsTestOtherB-2006431978-project-member] Enqueued Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_rules [ 1252.666677] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_rules [ 1252.667222] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.668209] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.104547] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.104879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.104879] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.105016] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.105164] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.105308] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b already deleted. [ 1253.105450] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.105660] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.105883] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.106012] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.627108] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.627293] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.627386] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.627588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.627694] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.627791] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b already deleted. [ 1253.627874] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.226958] env[65136]: INFO networking_nsxv3.common.synchronization [None req-660d14ca-e1ac-48d9-98bd-fde94cd72065 None None] Enqueued Resource ID: 16c2afb7-8005-4d04-b794-9aff4004f3d0 with Priority: HIGHEST for action port [ 1254.227509] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16c2afb7-8005-4d04-b794-9aff4004f3d0 with Priority: HIGHEST for action port [ 1254.227810] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-16c2afb7-8005-4d04-b794-9aff4004f3d0 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.227962] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16c2afb7-8005-4d04-b794-9aff4004f3d0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.228024] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16c2afb7-8005-4d04-b794-9aff4004f3d0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.228326] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16c2afb7-8005-4d04-b794-9aff4004f3d0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.229109] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16c2afb7-8005-4d04-b794-9aff4004f3d0',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.730986] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16c2afb7-8005-4d04-b794-9aff4004f3d0 [ 1254.731248] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.731385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.731456] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.731681] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.731775] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.731888] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16c2afb7-8005-4d04-b794-9aff4004f3d0 already deleted. [ 1254.731957] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16c2afb7-8005-4d04-b794-9aff4004f3d0" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.278292] env[65136]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1256.278739] env[65136]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1258.036878] env[65136]: INFO networking_nsxv3.common.synchronization [req-ff0c2964-553d-4c5b-979c-79097e30dcb5 req-4ec8427a-e94c-407d-992a-72e0abef1fa8 tempest-ServerActionsTestOtherB-2006431978 tempest-ServerActionsTestOtherB-2006431978-project-member] Enqueued Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_members [ 1258.037464] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_members [ 1258.037815] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.037914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.037967] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.038379] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.038541] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.038636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.038692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.039043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.039043] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.039043] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.310756] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-298 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.310961] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-298" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.311102] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-298" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.311429] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-298" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.311691] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.311846] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.311964] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.312192] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.312373] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.312592] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1258.312705] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1258.312814] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1258.312922] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1258.313049] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1258.313160] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1258.313288] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1258.335006] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1258.335226] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1258.335367] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1258.335541] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-298" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.335858] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-26951fb5-bfa2-4ed3-aff7-a770e4eb460b taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.336139] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-26951fb5-bfa2-4ed3-aff7-a770e4eb460b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.336295] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-26951fb5-bfa2-4ed3-aff7-a770e4eb460b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.336632] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-26951fb5-bfa2-4ed3-aff7-a770e4eb460b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.336754] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26951fb5-bfa2-4ed3-aff7-a770e4eb460b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.541083] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.541266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.541266] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.541481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.541570] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.541762] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.541858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.541917] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.542084] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.542169] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.542262] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b already deleted. [ 1258.542379] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.839523] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.839770] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.839897] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.840201] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.840349] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.840505] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 26951fb5-bfa2-4ed3-aff7-a770e4eb460b not found, creating... [ 1258.840758] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.840912] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.841043] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.841261] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.841396] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.841673] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.841825] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.841939] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.842170] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.842325] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.842473] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 26951fb5-bfa2-4ed3-aff7-a770e4eb460b is going to be created. [ 1258.861287] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.861486] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.861576] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.861815] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.862044] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.862270] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-26951fb5-bfa2-4ed3-aff7-a770e4eb460b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.549386] env[65136]: INFO networking_nsxv3.common.synchronization [req-ff0c2964-553d-4c5b-979c-79097e30dcb5 req-36de0fc3-0698-452d-b519-1977c9be1170 service nova] Enqueued Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_rules [ 1259.549626] env[65136]: INFO networking_nsxv3.common.synchronization [req-ff0c2964-553d-4c5b-979c-79097e30dcb5 req-36de0fc3-0698-452d-b519-1977c9be1170 service nova] Enqueued Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_members [ 1259.549703] env[65136]: INFO networking_nsxv3.common.synchronization [req-ff0c2964-553d-4c5b-979c-79097e30dcb5 req-36de0fc3-0698-452d-b519-1977c9be1170 service nova] Enqueued Resource ID: 26951fb5-bfa2-4ed3-aff7-a770e4eb460b with Priority: HIGHEST for action port [ 1259.550354] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_rules [ 1259.550625] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_members [ 1259.551099] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26951fb5-bfa2-4ed3-aff7-a770e4eb460b with Priority: HIGHEST for action port [ 1259.551175] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.551300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.551385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.551755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.551844] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.553182] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.553300] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.553370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.553536] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.553676] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.553780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.553839] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.554643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.554857] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.555024] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.555816] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-26951fb5-bfa2-4ed3-aff7-a770e4eb460b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.555955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26951fb5-bfa2-4ed3-aff7-a770e4eb460b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.556066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26951fb5-bfa2-4ed3-aff7-a770e4eb460b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.556298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26951fb5-bfa2-4ed3-aff7-a770e4eb460b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.556446] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26951fb5-bfa2-4ed3-aff7-a770e4eb460b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.058515] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.058675] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.058852] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.059775] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26951fb5-bfa2-4ed3-aff7-a770e4eb460b with status ACTIVE [ 1260.059960] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.060086] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.060155] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.060359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.060448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.060617] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.060715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.060776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.060922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.061007] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.061188] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.061283] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.061344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.061505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.061575] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.061661] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26951fb5-bfa2-4ed3-aff7-a770e4eb460b is going to be updated. [ 1260.081424] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.081626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.081626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.081823] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.081954] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.082223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26951fb5-bfa2-4ed3-aff7-a770e4eb460b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.564286] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.066721] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.066997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.067138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.067387] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.067484] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.067584] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b is going to be created. [ 1261.091929] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.092166] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.092231] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.092482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.092698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.102379] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: UNINITIALIZED for 2s [ 1263.112698] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: SUCCESS [ 1263.113075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.113075] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.113257] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.113448] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.113576] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.113630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.113802] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.113903] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.113992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.114113] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.617310] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.119706] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4fd8792-0051-494d-99b4-51e73bc1148b: rpc.has_security_group_logging(os_id): False [ 1264.136523] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.136739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.136739] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.136934] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.137037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.137288] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.137390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.137457] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.137610] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.137683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.137769] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b is going to be created. [ 1264.194729] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.194952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.194952] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.195186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.195370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.205617] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: IN_PROGRESS for 2s [ 1264.552431] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1264.552627] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1264.729608] env[65136]: INFO networking_nsxv3.common.synchronization [req-17f566de-8395-4151-b4dd-62e85a1c2aba req-84277120-c1a9-4fe2-8639-0184ab8101d3 tempest-ServerActionsTestOtherA-1102352866 tempest-ServerActionsTestOtherA-1102352866-project-member] Enqueued Resource ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 with Priority: HIGHEST for action security_group_members [ 1264.730150] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 with Priority: HIGHEST for action security_group_members [ 1264.730462] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-140e14c8-58c7-45d7-b4d2-76922c1f6b26 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.730591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.730659] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.730864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.731198] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.731307] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.731372] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.731602] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.731698] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.731796] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('140e14c8-58c7-45d7-b4d2-76922c1f6b26',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.234526] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.234930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.234930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.234930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.235046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.235254] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.235466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.235466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.235592] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.235667] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.235752] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 is going to be updated. [ 1265.262473] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.262758] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.262824] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.263094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.263287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.271597] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 in Status: IN_PROGRESS for 2s [ 1266.216841] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: SUCCESS [ 1266.217151] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.281359] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 in Status: SUCCESS [ 1267.281725] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 140e14c8-58c7-45d7-b4d2-76922c1f6b26 deletion is rescheduled due to dependency. [ 1267.281725] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-140e14c8-58c7-45d7-b4d2-76922c1f6b26" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.731193] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1269.731450] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1274.210825] env[65136]: INFO networking_nsxv3.common.synchronization [req-51f71e36-b9cd-45b6-abdc-302ac71da07c req-59cfafc3-d340-4bb4-b62b-8288af9f1c8c tempest-ServerActionsTestOtherA-1102352866 tempest-ServerActionsTestOtherA-1102352866-project-member] Enqueued Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_members [ 1274.211978] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_members [ 1274.211978] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.211978] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.211978] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.212284] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.212284] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.212702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.212702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.212702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.212702] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.212930] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.507690] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.507912] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.508073] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.508305] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.508566] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.508725] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.508842] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.509065] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.509209] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.509420] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.509550] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1274.509661] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1274.509769] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1274.509879] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.509983] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1274.510126] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.531433] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.531601] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1274.531723] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.531892] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.532275] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-7bcb5800-febe-4bcf-9b29-95311cb2581b taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.532537] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-7bcb5800-febe-4bcf-9b29-95311cb2581b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.532672] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-7bcb5800-febe-4bcf-9b29-95311cb2581b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.532979] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-7bcb5800-febe-4bcf-9b29-95311cb2581b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.533132] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bcb5800-febe-4bcf-9b29-95311cb2581b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.715826] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.716111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.716111] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.716271] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.716360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.716556] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.716656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.716720] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.716861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.716936] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.717036] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 is going to be updated. [ 1274.748051] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.748282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.748282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.748458] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.748645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.757591] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 in Status: IN_PROGRESS for 2s [ 1275.035788] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.036052] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.036211] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.036533] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.036723] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.036920] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Segment Port 7bcb5800-febe-4bcf-9b29-95311cb2581b not found, creating... [ 1275.037235] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.037414] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.037612] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.037823] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.037996] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.038335] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.038530] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.038689] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.038936] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.039134] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.039310] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 7bcb5800-febe-4bcf-9b29-95311cb2581b is going to be created. [ 1275.061107] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.061346] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.061502] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.061825] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.062127] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.062397] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-7bcb5800-febe-4bcf-9b29-95311cb2581b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.755926] env[65136]: INFO networking_nsxv3.common.synchronization [req-51f71e36-b9cd-45b6-abdc-302ac71da07c req-b8d2f473-1320-4bfe-9fbc-ecabb3a29427 service nova] Enqueued Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_rules [ 1275.756237] env[65136]: INFO networking_nsxv3.common.synchronization [req-51f71e36-b9cd-45b6-abdc-302ac71da07c req-b8d2f473-1320-4bfe-9fbc-ecabb3a29427 service nova] Enqueued Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_members [ 1275.756237] env[65136]: INFO networking_nsxv3.common.synchronization [req-51f71e36-b9cd-45b6-abdc-302ac71da07c req-b8d2f473-1320-4bfe-9fbc-ecabb3a29427 service nova] Enqueued Resource ID: 7bcb5800-febe-4bcf-9b29-95311cb2581b with Priority: HIGHEST for action port [ 1275.756726] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_rules [ 1275.756860] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_members [ 1275.756959] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcb5800-febe-4bcf-9b29-95311cb2581b with Priority: HIGHEST for action port [ 1275.757266] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.757363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.757489] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.757626] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.757714] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.758583] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.758683] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.758893] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bcb5800-febe-4bcf-9b29-95311cb2581b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.759018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bcb5800-febe-4bcf-9b29-95311cb2581b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.759018] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bcb5800-febe-4bcf-9b29-95311cb2581b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.759188] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bcb5800-febe-4bcf-9b29-95311cb2581b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.759265] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bcb5800-febe-4bcf-9b29-95311cb2581b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.261818] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.261818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.262133] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7bcb5800-febe-4bcf-9b29-95311cb2581b with status ACTIVE [ 1276.262299] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.262469] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.262596] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.262832] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.262950] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.263181] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.263276] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.263343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.263499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.263580] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.263760] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.263851] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.263913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.264064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.264139] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.264223] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7bcb5800-febe-4bcf-9b29-95311cb2581b is going to be updated. [ 1276.287267] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.287488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.287488] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.287668] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.287805] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.287955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bcb5800-febe-4bcf-9b29-95311cb2581b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.766791] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 in Status: SUCCESS [ 1276.767213] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 deletion is rescheduled due to dependency. [ 1276.767213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.767299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.767446] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.767623] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.767790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.767790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.767964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.768036] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.768130] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.271060] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.773209] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.277065] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.277065] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.277065] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.277065] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.277065] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.277065] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 is going to be updated. [ 1278.304198] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.304396] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.304396] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.304669] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.304842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.314066] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 in Status: IN_PROGRESS for 2s [ 1280.327517] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 in Status: SUCCESS [ 1280.327902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.327902] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.328064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.328265] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.328384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.328453] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.328614] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.328703] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.328785] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.328877] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.758455] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1280.758652] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1280.831297] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.831537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.831585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.831782] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.832029] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.832184] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.832286] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.832506] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.832643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.832764] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.832956] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.833105] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.833193] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.833361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.833521] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.833641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.833715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.833892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.833976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.834097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.834200] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.336583] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46: rpc.has_security_group_logging(os_id): False [ 1281.358026] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.358249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.358249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.358456] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.358544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.358765] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.358866] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.358930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.359097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.359175] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.359352] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.359445] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.359506] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.359643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.359717] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.359904] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.359996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.360068] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.360205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.360279] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.360362] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 is going to be updated. [ 1281.519347] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.519580] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.519580] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.519775] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.519930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.532111] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 in Status: IN_PROGRESS for 2s [ 1283.546939] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 in Status: SUCCESS [ 1283.547352] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.121750] env[65136]: INFO networking_nsxv3.common.synchronization [req-aa78310c-3438-4226-8085-e6c45c44802a req-12c1a3ca-f405-40c6-8a83-fdc3d5941186 tempest-ServerActionsTestOtherA-1102352866 tempest-ServerActionsTestOtherA-1102352866-project-member] Enqueued Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_members [ 1284.121922] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGHEST for action security_group_members [ 1284.122425] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.122425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.122425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.122569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.122676] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.122762] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.122818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.122961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.123058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.123158] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.171106] env[65136]: INFO networking_nsxv3.common.synchronization [req-aa78310c-3438-4226-8085-e6c45c44802a req-12c1a3ca-f405-40c6-8a83-fdc3d5941186 tempest-ServerActionsTestOtherA-1102352866 tempest-ServerActionsTestOtherA-1102352866-project-member] Enqueued Resource ID: 7bcb5800-febe-4bcf-9b29-95311cb2581b with Priority: HIGHEST for action port [ 1284.171849] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bcb5800-febe-4bcf-9b29-95311cb2581b with Priority: HIGHEST for action port [ 1284.172179] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bcb5800-febe-4bcf-9b29-95311cb2581b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.172306] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bcb5800-febe-4bcf-9b29-95311cb2581b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.172364] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bcb5800-febe-4bcf-9b29-95311cb2581b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.172569] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bcb5800-febe-4bcf-9b29-95311cb2581b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.172664] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bcb5800-febe-4bcf-9b29-95311cb2581b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.625406] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.625834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.625834] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.625913] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.626087] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.626230] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.626352] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.626414] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.626579] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.626658] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.626748] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 is going to be updated. [ 1284.657060] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.657344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.657344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.657616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.657812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.668369] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 in Status: IN_PROGRESS for 2s [ 1284.674786] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7bcb5800-febe-4bcf-9b29-95311cb2581b with status ACTIVE [ 1284.675062] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.675200] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.675279] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.675556] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.675662] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.675930] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.676066] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.676181] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.676371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.676476] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.676722] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.676836] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.676942] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.677143] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.677241] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.677365] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7bcb5800-febe-4bcf-9b29-95311cb2581b is going to be updated. [ 1284.700281] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.700493] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.700493] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.700777] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.700935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.701159] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bcb5800-febe-4bcf-9b29-95311cb2581b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.677729] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 in Status: SUCCESS [ 1286.678058] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 deletion is rescheduled due to dependency. [ 1286.678058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.172475] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1289.172859] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1294.173706] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1294.174094] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1298.219568] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.219887] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.219887] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.220239] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.220375] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.722654] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.174821] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1299.175040] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1299.224584] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.727290] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1299.727443] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1300.511537] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.511955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.511955] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.512255] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.536038] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1300.536989] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.538226] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1300.585239] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.585512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.585512] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.585645] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.599521] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.600311] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1300.600397] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1300.600484] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1300.641374] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.641812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.641812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.641812] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.643099] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.643292] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1300.722924] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.723158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.723158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.723370] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.723688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.723982] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1300.797076] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.797367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.797367] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.797496] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.797769] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.798102] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:43. [ 1300.798197] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'b4fd8792-0051-494d-99b4-51e73bc1148b', '34781a01-2f7c-494e-a20f-c65d97596e05', '0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46', '2ffd4802-244f-43db-9a7c-a5a1b6672fde', '442ff863-0294-4912-9ccc-90fba7170dc2', 'a99f7e35-ad71-4640-a081-3c507e997901', '627dff8d-ead1-4820-9473-3d8056d3cd8b', '341154f1-9b0b-43bc-8e74-163cf220f74c', 'd7b37bfd-119e-4a70-9b16-a4796e90a688', '605661ba-c8c2-4dae-8382-f55a5d1ead5d', '50fff4b6-41a4-4814-b10b-190839692ac8', 'f5ef8f7d-8350-4fe2-9bef-70ff70b5f141', 'c9e25239-cb71-43b7-9bce-b16b700986d4', '0e10abd8-e332-4023-ac76-224c24377bec', 'dbb8b9b9-cf98-4843-a063-345334ac585b', 'e3d3368d-c817-476c-9744-dc804689a94b', '4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b', 'a0070031-3f89-4a59-8e86-79ba8d922e5b', 'c713a5b4-d91d-4c9c-8670-3e057521cf54', '2c51c2cd-9219-40af-b979-dfebe3666f2e', '06b0bf22-61b9-4a96-a3f3-ec08a80369b4', '93ccbc3a-3e56-44ad-acca-e50d0d0ea6e5', '988c7ed3-0eb3-45cb-bb2b-70bf96dd6d15', 'ac3eebaf-da3a-488c-83dd-470138abdfc8', '00e6e52b-cc63-4ca5-a21d-f9f7edad2a4e', 'a503f8a3-35c3-4780-8cb3-fb17a0c4a452', 'f599cf2b-60b7-4420-ad22-ed55d836f3a9', 'd5eb0c9f-3d40-4ee6-a7eb-fa0cbba36f1c', 'bb9ff62c-64bb-4ec0-8e08-87a27863a22e', 'd34f355b-9e16-4e39-9a04-e9b1d96e578e', '140e14c8-58c7-45d7-b4d2-76922c1f6b26', '5640a309-d0fa-4870-9eee-f2caeb1f4b8d', 'f4f6034d-9ad4-409e-9b4a-d6ffaa597a63', '9a9a81b8-cfea-4cf0-a7c1-6c152505127c', 'bda9d3e7-3fa7-45fd-a4c8-a8bc83ab4331', 'ea847179-b3cb-478f-bcdc-0c75dc43c2bc', '9f4dd229-f786-4bea-badc-2a0fea17968f', '6d7f4864-4465-4dbe-9836-f8fba02f451c', 'e076b0f0-4401-42ce-b608-41c3e6db24f9', '4450efc3-afd8-4465-8453-713d205d5684', '39322202-687d-409e-86ef-4870f36135e8', '37877b3d-4d86-4b8f-9dbc-8f064b2bbcf6', '5a04e899-b185-4f20-8eea-e0edb95feabb'} {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1300.798296] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1300.817139] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.817334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.817375] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.817551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.817633] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.817740] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1300.817814] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1300.817888] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1300.890500] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.890663] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.890740] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.890973] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.892345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.892680] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1300.892795] env[65136]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65136) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1300.892913] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1300.892995] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1300.893095] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/43 resources of Type:Security Group Rules [ 1300.893187] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGH for action security_group_rules [ 1300.893271] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34781a01-2f7c-494e-a20f-c65d97596e05 with Priority: HIGH for action security_group_rules [ 1300.893342] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGH for action security_group_rules [ 1300.893407] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGH for action security_group_rules [ 1300.893471] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 442ff863-0294-4912-9ccc-90fba7170dc2 with Priority: HIGH for action security_group_rules [ 1300.893536] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGH for action security_group_rules [ 1300.893597] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b with Priority: HIGH for action security_group_rules [ 1300.893659] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGH for action security_group_rules [ 1300.893723] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGH for action security_group_rules [ 1300.893788] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGH for action security_group_rules [ 1300.893987] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 50fff4b6-41a4-4814-b10b-190839692ac8 with Priority: HIGH for action security_group_rules [ 1300.893987] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGH for action security_group_rules [ 1300.893987] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c9e25239-cb71-43b7-9bce-b16b700986d4 with Priority: HIGH for action security_group_rules [ 1300.894091] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0e10abd8-e332-4023-ac76-224c24377bec with Priority: HIGH for action security_group_rules [ 1300.894218] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbb8b9b9-cf98-4843-a063-345334ac585b with Priority: HIGH for action security_group_rules [ 1300.894218] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGH for action security_group_rules [ 1300.894268] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGH for action security_group_rules [ 1300.894298] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a0070031-3f89-4a59-8e86-79ba8d922e5b with Priority: HIGH for action security_group_rules [ 1300.894388] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGH for action security_group_rules [ 1300.894431] env[65136]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e with Priority: HIGH for action security_group_rules [ 1300.894608] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.175857] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1304.176190] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1304.176190] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGH for action security_group_rules [ 1304.176266] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 with Priority: HIGH for action security_group_rules [ 1304.176346] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b with Priority: HIGH for action security_group_rules [ 1304.176452] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbb8b9b9-cf98-4843-a063-345334ac585b with Priority: HIGH for action security_group_rules [ 1304.176552] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e with Priority: HIGH for action security_group_rules [ 1304.176649] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 with Priority: HIGH for action security_group_rules [ 1304.176743] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0070031-3f89-4a59-8e86-79ba8d922e5b with Priority: HIGH for action security_group_rules [ 1304.176835] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b with Priority: HIGH for action security_group_rules [ 1304.176928] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e10abd8-e332-4023-ac76-224c24377bec with Priority: HIGH for action security_group_rules [ 1304.177300] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGH for action security_group_rules [ 1304.177300] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9e25239-cb71-43b7-9bce-b16b700986d4 with Priority: HIGH for action security_group_rules [ 1304.177300] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 with Priority: HIGH for action security_group_rules [ 1304.177300] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50fff4b6-41a4-4814-b10b-190839692ac8 with Priority: HIGH for action security_group_rules [ 1304.177409] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d with Priority: HIGH for action security_group_rules [ 1304.177530] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 with Priority: HIGH for action security_group_rules [ 1304.177588] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a99f7e35-ad71-4640-a081-3c507e997901 with Priority: HIGH for action security_group_rules [ 1304.177636] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 341154f1-9b0b-43bc-8e74-163cf220f74c with Priority: HIGH for action security_group_rules [ 1304.177728] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 442ff863-0294-4912-9ccc-90fba7170dc2 with Priority: HIGH for action security_group_rules [ 1304.177816] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34781a01-2f7c-494e-a20f-c65d97596e05 with Priority: HIGH for action security_group_rules [ 1304.177906] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde with Priority: HIGH for action security_group_rules [ 1304.178262] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.178918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.178918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.178918] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.178918] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.179681] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.179795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.179860] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.180038] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.180117] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.181101] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-627dff8d-ead1-4820-9473-3d8056d3cd8b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.181201] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.181425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.181425] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.181522] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('627dff8d-ead1-4820-9473-3d8056d3cd8b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.182215] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dbb8b9b9-cf98-4843-a063-345334ac585b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.182328] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.182328] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.182450] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.182519] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dbb8b9b9-cf98-4843-a063-345334ac585b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.183222] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2c51c2cd-9219-40af-b979-dfebe3666f2e taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.183340] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.183385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.183520] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.183591] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2c51c2cd-9219-40af-b979-dfebe3666f2e',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.184256] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c713a5b4-d91d-4c9c-8670-3e057521cf54 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.184256] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.184630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.184630] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.184630] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c713a5b4-d91d-4c9c-8670-3e057521cf54',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.185449] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0070031-3f89-4a59-8e86-79ba8d922e5b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.185554] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.186213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.186213] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.186213] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0070031-3f89-4a59-8e86-79ba8d922e5b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.187122] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.187122] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.187122] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.187122] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.187122] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.187482] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e10abd8-e332-4023-ac76-224c24377bec taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.187647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.187647] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.188017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.188017] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e10abd8-e332-4023-ac76-224c24377bec',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.188858] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3d3368d-c817-476c-9744-dc804689a94b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.188858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.188858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.188858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.189080] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.189639] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c9e25239-cb71-43b7-9bce-b16b700986d4 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.189733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.189966] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.189966] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.190087] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c9e25239-cb71-43b7-9bce-b16b700986d4',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.190945] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.190945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.190945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.191136] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.191136] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5ef8f7d-8350-4fe2-9bef-70ff70b5f141',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.191699] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-50fff4b6-41a4-4814-b10b-190839692ac8 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.191806] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.191869] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.192278] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.192278] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('50fff4b6-41a4-4814-b10b-190839692ac8',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.194365] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.194466] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.194518] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.194909] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.194909] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('605661ba-c8c2-4dae-8382-f55a5d1ead5d',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.195534] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7b37bfd-119e-4a70-9b16-a4796e90a688 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.195534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.195674] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.195711] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.195747] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7b37bfd-119e-4a70-9b16-a4796e90a688',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.196401] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a99f7e35-ad71-4640-a081-3c507e997901 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.196503] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.196545] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.196692] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.196764] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a99f7e35-ad71-4640-a081-3c507e997901',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.197436] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-341154f1-9b0b-43bc-8e74-163cf220f74c taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.197539] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.197604] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.197749] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.197821] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('341154f1-9b0b-43bc-8e74-163cf220f74c',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.198602] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-442ff863-0294-4912-9ccc-90fba7170dc2 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.198666] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.198742] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.198895] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.198961] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('442ff863-0294-4912-9ccc-90fba7170dc2',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.199618] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34781a01-2f7c-494e-a20f-c65d97596e05 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.200037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.200037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.200037] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.200037] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34781a01-2f7c-494e-a20f-c65d97596e05',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.200635] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.201104] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.201104] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.201104] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.201104] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ffd4802-244f-43db-9a7c-a5a1b6672fde',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.708373] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.708559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.708609] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.708944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.709144] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.709249] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.709315] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.709467] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.709551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.709638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.709724] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.726054] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d3368d-c817-476c-9744-dc804689a94b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.726310] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.726310] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.726464] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.726618] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.726711] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.726773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.726910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.726992] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.727090] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.727177] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.794338] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.794550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.794642] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.794934] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.797373] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.797481] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.798400] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.798544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.799484] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.799589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.800349] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.800495] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.801409] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.801550] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.802441] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.802589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.803972] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.804144] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.805116] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.805260] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.805957] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.806057] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.806743] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.806833] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.807417] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1304.807828] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.807919] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.808514] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1304.809008] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.809149] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.809792] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1304.810205] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.810327] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.810903] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1304.811306] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.811448] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.812439] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1304.813029] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.813029] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.813661] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1304.814050] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.814192] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.814843] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1304.815253] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.815390] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.822235] env[65136]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1304.822881] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.823106] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5ef8f7d-8350-4fe2-9bef-70ff70b5f141 is going to be deleted. [ 1304.825572] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.825780] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.843572] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.843705] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 627dff8d-ead1-4820-9473-3d8056d3cd8b is going to be deleted. [ 1304.844588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.844915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.864250] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.864408] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2c51c2cd-9219-40af-b979-dfebe3666f2e is going to be deleted. [ 1304.865233] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.865436] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.887238] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.887396] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e10abd8-e332-4023-ac76-224c24377bec is going to be deleted. [ 1304.888474] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.888726] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.890336] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.890451] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.910179] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.910379] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0070031-3f89-4a59-8e86-79ba8d922e5b is going to be deleted. [ 1304.911505] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.911715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.913161] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.913265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.918817] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.918972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.933544] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.933678] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a99f7e35-ad71-4640-a081-3c507e997901 is going to be deleted. [ 1304.934501] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.934709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.967039] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.967186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.969997] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.970149] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 50fff4b6-41a4-4814-b10b-190839692ac8 is going to be deleted. [ 1304.971058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.971281] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.014555] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.014733] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.041797] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.041947] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46 is going to be deleted. [ 1305.042818] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.043074] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.088208] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.088386] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.105534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.105706] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 442ff863-0294-4912-9ccc-90fba7170dc2 is going to be deleted. [ 1305.106746] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.106986] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.137877] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.138055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.178741] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.179073] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c713a5b4-d91d-4c9c-8670-3e057521cf54 is going to be deleted. [ 1305.179788] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.180014] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.181912] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.182027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.217237] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.238700] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.254242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.254417] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 341154f1-9b0b-43bc-8e74-163cf220f74c is going to be deleted. [ 1305.255330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.255543] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.270809] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.271050] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.278998] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.279244] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 605661ba-c8c2-4dae-8382-f55a5d1ead5d is going to be deleted. [ 1305.280372] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.280601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.299323] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.299534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.308934] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.309092] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34781a01-2f7c-494e-a20f-c65d97596e05 is going to be deleted. [ 1305.310015] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.310251] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.387906] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.388098] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b is going to be deleted. [ 1305.388935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.389176] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.391880] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.392055] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.399192] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.399350] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.432726] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.432973] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.446583] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.446745] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c9e25239-cb71-43b7-9bce-b16b700986d4 is going to be deleted. [ 1305.447760] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.447976] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.483047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.483228] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dbb8b9b9-cf98-4843-a063-345334ac585b is going to be deleted. [ 1305.484360] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.484689] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.531486] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.531679] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7b37bfd-119e-4a70-9b16-a4796e90a688 is going to be deleted. [ 1305.532542] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.532844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.540577] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.540763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.587746] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.587944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.605071] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.605246] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ffd4802-244f-43db-9a7c-a5a1b6672fde is going to be deleted. [ 1305.606162] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.606405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.606510] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.606632] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5ef8f7d-8350-4fe2-9bef-70ff70b5f141" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.607445] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.607547] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.607616] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.607784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.607864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.607974] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dbb8b9b9-cf98-4843-a063-345334ac585b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.608127] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.608287] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.608338] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.608452] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-627dff8d-ead1-4820-9473-3d8056d3cd8b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.608933] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.609119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.609190] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.609334] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2c51c2cd-9219-40af-b979-dfebe3666f2e" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.609468] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.609605] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.609682] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.609792] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e10abd8-e332-4023-ac76-224c24377bec" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.609904] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.610053] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.610130] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.610242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0070031-3f89-4a59-8e86-79ba8d922e5b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.610372] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.610509] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.610584] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.610691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a99f7e35-ad71-4640-a081-3c507e997901" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.610802] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.610938] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.611023] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.611138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-50fff4b6-41a4-4814-b10b-190839692ac8" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.611265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.611405] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.611478] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.611585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b0b16a7-29b7-42b2-9c5f-9a5f81d1dc46" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.611696] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.611831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.611904] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.612030] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-442ff863-0294-4912-9ccc-90fba7170dc2" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.612160] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.612298] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.612371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.612480] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c713a5b4-d91d-4c9c-8670-3e057521cf54" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.612589] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.612722] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.612795] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.612910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-341154f1-9b0b-43bc-8e74-163cf220f74c" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.613047] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.613186] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.613261] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.613371] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-605661ba-c8c2-4dae-8382-f55a5d1ead5d" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.613482] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.613617] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.613691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.613799] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34781a01-2f7c-494e-a20f-c65d97596e05" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.613922] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.614070] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.614150] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.614272] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4aa78eaf-b01b-4c1a-afa9-8a76cae9c34b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.614388] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.614526] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.614598] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.614700] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c9e25239-cb71-43b7-9bce-b16b700986d4" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.694637] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.694870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.694870] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.695131] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.695228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.695346] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7b37bfd-119e-4a70-9b16-a4796e90a688" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.718863] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4fd8792-0051-494d-99b4-51e73bc1148b: rpc.has_security_group_logging(os_id): False [ 1305.740735] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3d3368d-c817-476c-9744-dc804689a94b: rpc.has_security_group_logging(os_id): False [ 1305.742642] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.742796] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.742842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.743096] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.746831] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.746972] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.776107] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.776455] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.776559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.776629] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.776842] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.776930] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.777035] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b is going to be updated. [ 1305.778265] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.778444] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.778535] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.778646] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ffd4802-244f-43db-9a7c-a5a1b6672fde" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.779536] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.779643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.779719] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.779846] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.813127] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.813462] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.813585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.813693] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.813864] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.813945] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.814068] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3d3368d-c817-476c-9744-dc804689a94b is going to be updated. [ 1305.906046] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.906384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.906384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.906486] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.906643] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.920453] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: IN_PROGRESS for 2s [ 1305.930246] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.930433] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.930433] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.930684] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.930843] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.945554] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: IN_PROGRESS for 2s [ 1307.933053] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: SUCCESS [ 1307.933430] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.957807] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: SUCCESS [ 1307.958098] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.179298] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1309.179298] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1310.881400] env[65136]: INFO networking_nsxv3.common.synchronization [req-f9a9b5f6-c867-46c4-a585-8c56e79a7ed3 req-9dfe12df-2c40-42af-b677-ef2be9aaec0a tempest-ServerActionsTestOtherA-1102352866 tempest-ServerActionsTestOtherA-1102352866-project-member] Enqueued Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_members [ 1310.882303] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_members [ 1310.882757] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d3368d-c817-476c-9744-dc804689a94b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.882926] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.883065] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.883353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.883630] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.883810] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.883899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.884141] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.884273] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.884420] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.159764] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.160942] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.160942] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.160942] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.160942] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.160942] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.161230] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.161230] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.161456] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.161722] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1311.161836] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1311.161943] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1311.162069] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1311.162180] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1311.162285] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1311.162418] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1311.185163] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1311.185362] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1311.185493] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1311.185664] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-910" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.185974] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.186283] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.186371] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.186677] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.186812] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.387708] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.689213] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.689548] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.689724] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.690050] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.690262] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.690472] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37 not found, creating... [ 1311.690764] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.690933] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.691059] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.691299] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.691433] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.691751] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.691954] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.692104] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.692326] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.692446] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.692600] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37 is going to be created. [ 1311.718089] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.718428] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.718621] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.718989] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.719342] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.719643] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.890057] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.392197] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.392438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.392438] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.392653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.392773] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.392875] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d3368d-c817-476c-9744-dc804689a94b is going to be updated. [ 1312.417928] env[65136]: INFO networking_nsxv3.common.synchronization [req-f9a9b5f6-c867-46c4-a585-8c56e79a7ed3 req-88d82c1a-0894-4a82-a0b0-2b4717ed6557 service nova] Enqueued Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_rules [ 1312.418505] env[65136]: INFO networking_nsxv3.common.synchronization [req-f9a9b5f6-c867-46c4-a585-8c56e79a7ed3 req-88d82c1a-0894-4a82-a0b0-2b4717ed6557 service nova] Enqueued Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_members [ 1312.418679] env[65136]: INFO networking_nsxv3.common.synchronization [req-f9a9b5f6-c867-46c4-a585-8c56e79a7ed3 req-88d82c1a-0894-4a82-a0b0-2b4717ed6557 service nova] Enqueued Resource ID: 7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37 with Priority: HIGHEST for action port [ 1312.419495] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_rules [ 1312.419668] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_members [ 1312.419764] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37 with Priority: HIGHEST for action port [ 1312.420077] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e3d3368d-c817-476c-9744-dc804689a94b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.420205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.420273] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.420732] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.420816] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.421872] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d3368d-c817-476c-9744-dc804689a94b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.421959] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.422204] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.422303] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.422356] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.422559] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.422640] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.432163] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.432163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.432163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.432163] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.432461] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.442735] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: IN_PROGRESS for 2s [ 1312.924344] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d3368d-c817-476c-9744-dc804689a94b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.924756] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.924756] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37 with status ACTIVE [ 1312.924826] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.926019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.926019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.926019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.926019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.926019] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.926019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.926019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.926019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.926019] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.926582] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.926582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.926582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.926582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.926582] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.926582] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37 is going to be updated. [ 1312.949977] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.950258] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.950339] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.950524] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.950661] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.950826] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ed0a2de-5c52-4549-8c4f-49fcc9f7bf37" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.452900] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: SUCCESS [ 1314.453345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.453345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.453636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.453842] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.453964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.454046] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.454215] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.454299] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.454400] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.957089] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.459668] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.962840] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.963158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.963158] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.963337] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.963436] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.963540] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d3368d-c817-476c-9744-dc804689a94b is going to be updated. [ 1315.994215] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.994431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.994431] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.994624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.994770] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.004388] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: IN_PROGRESS for 2s [ 1317.421319] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1317.421722] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1318.016080] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: SUCCESS [ 1318.016376] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.016612] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.016858] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.017099] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.017212] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.017282] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.017499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.017585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.017700] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.017842] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.520907] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.023923] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e3d3368d-c817-476c-9744-dc804689a94b: rpc.has_security_group_logging(os_id): False [ 1319.044752] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.044844] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.044899] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.045221] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.045343] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.045554] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.045653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.045717] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.045868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.045946] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.046065] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e3d3368d-c817-476c-9744-dc804689a94b is going to be updated. [ 1319.113762] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.113961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.113961] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.114228] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.114314] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.128666] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: IN_PROGRESS for 2s [ 1321.143049] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: SUCCESS [ 1321.143424] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.423014] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1322.423286] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1327.424428] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1327.424768] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1332.425784] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1332.426159] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1337.426914] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1337.427205] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1342.428197] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1342.428623] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1347.428992] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1347.429340] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1352.430722] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1352.430722] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1357.431621] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1357.431974] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1362.432470] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1362.432910] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1367.434542] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1367.434542] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1372.434460] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.434857] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.435328] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.435708] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.824862] env[65136]: INFO networking_nsxv3.common.synchronization [req-86adb544-3974-44d0-bce4-ab5f97fc5693 req-a3b5ea72-275c-4387-8035-67fd57254a29 tempest-ServerActionsTestOtherA-1102352866 tempest-ServerActionsTestOtherA-1102352866-project-member] Enqueued Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_members [ 1377.825379] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_members [ 1377.825685] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d3368d-c817-476c-9744-dc804689a94b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.825804] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.825891] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.826498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.826498] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.826498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.826498] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.826656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.826656] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.826719] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.329243] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.832047] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.335118] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.335118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.335118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.335118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.335118] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.335118] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d3368d-c817-476c-9744-dc804689a94b is going to be updated. [ 1379.371121] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.371345] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.371426] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.371651] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.371799] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.380884] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: IN_PROGRESS for 2s [ 1381.392513] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: SUCCESS [ 1381.392513] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1382.827382] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1382.827805] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.062148] env[65136]: INFO networking_nsxv3.common.synchronization [req-79eb3c14-7156-4f36-9bdc-7dce20dfd0d0 req-09f7eceb-1e04-41ee-81e5-f207ccd75b59 tempest-ServerActionsTestOtherB-2006431978 tempest-ServerActionsTestOtherB-2006431978-project-member] Enqueued Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_members [ 1386.063394] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_members [ 1386.063738] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.063868] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.063960] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.064214] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.064394] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.064499] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.064568] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.064715] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.064802] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.064901] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.567475] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.567720] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.567720] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.567914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.568017] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.568218] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.568318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.568380] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.568537] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.568611] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.568697] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b is going to be updated. [ 1386.595271] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.595487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.595487] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.595606] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.595738] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.604076] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: IN_PROGRESS for 2s [ 1388.616173] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: SUCCESS [ 1388.616777] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b deletion is rescheduled due to dependency. [ 1388.616777] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.993472] env[65136]: INFO networking_nsxv3.common.synchronization [req-682f580c-a023-40a0-bbf1-854d811f92ca req-0ac84fad-d188-402f-816f-174dab433bac tempest-ServerActionsTestOtherA-1102352866 tempest-ServerActionsTestOtherA-1102352866-project-member] Enqueued Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_members [ 1390.994085] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d3368d-c817-476c-9744-dc804689a94b with Priority: HIGHEST for action security_group_members [ 1390.994451] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-e3d3368d-c817-476c-9744-dc804689a94b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.994585] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.994657] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.994848] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.994997] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1390.995141] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1390.995211] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1390.995351] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1390.995436] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1390.995528] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e3d3368d-c817-476c-9744-dc804689a94b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.498291] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.498291] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.498291] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.498291] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.498590] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.498625] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.498718] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.498778] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.498937] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.499034] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.499130] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d3368d-c817-476c-9744-dc804689a94b is going to be updated. [ 1391.530460] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.530653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.530653] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.530865] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.531022] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.539216] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: IN_PROGRESS for 2s [ 1393.012729] env[65136]: INFO networking_nsxv3.common.synchronization [req-2202e3b6-9edd-4cd5-bb6b-7ca5591f3228 req-b05ea2e0-b2ff-4854-8cb5-94a6c1d2e142 tempest-ServerActionsTestOtherB-2006431978 tempest-ServerActionsTestOtherB-2006431978-project-member] Enqueued Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_members [ 1393.013313] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_members [ 1393.013666] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.013794] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.013905] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.014306] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.014492] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.015135] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.015242] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.015479] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.015636] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.015759] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.321272] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock network-298 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.321469] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "network-298" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.321594] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "network-298" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.321860] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "network-298" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.322453] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.322619] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.322741] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.322953] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.323112] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.323347] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1393.323461] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1393.323578] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1393.323688] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1393.323799] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1393.323908] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1393.324088] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1393.349127] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1393.349326] env[65136]: DEBUG dogpile.cache.region [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1393.349464] env[65136]: DEBUG dogpile.lock [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1393.349688] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "network-298" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.350029] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock port-2daf272f-0f94-4123-8833-cd1b0803fe27 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.350211] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.350337] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.350715] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.350855] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2daf272f-0f94-4123-8833-cd1b0803fe27',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.518755] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.518981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.519060] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.519267] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.519363] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.519579] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.519691] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.519801] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.519929] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.520081] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.520139] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b is going to be updated. [ 1393.559116] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e3d3368d-c817-476c-9744-dc804689a94b in Status: SUCCESS [ 1393.559284] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e3d3368d-c817-476c-9744-dc804689a94b deletion is rescheduled due to dependency. [ 1393.559368] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e3d3368d-c817-476c-9744-dc804689a94b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.573510] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.573709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.573709] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.573929] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.574138] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.584283] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: IN_PROGRESS for 2s [ 1393.855692] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.855951] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.856070] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.856391] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.856538] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.857730] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Segment Port 2daf272f-0f94-4123-8833-cd1b0803fe27 not found, creating... [ 1393.857730] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.857730] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.857730] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.857730] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.857730] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.858015] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.858015] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.858145] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.858317] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.858477] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.858622] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Resource: SegmentPort with ID: 2daf272f-0f94-4123-8833-cd1b0803fe27 is going to be created. [ 1393.878784] env[65136]: DEBUG networking_nsxv3.common.locking [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.879020] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.879117] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.879455] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.879693] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.879921] env[65136]: DEBUG oslo_concurrency.lockutils [None req-fa80c47f-ff9e-4fae-a45a-4c1fcf25074c None None] Releasing lock "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1394.891358] env[65136]: INFO networking_nsxv3.common.synchronization [req-2202e3b6-9edd-4cd5-bb6b-7ca5591f3228 req-eab7eae9-5809-419c-a638-5549a494353f service nova] Enqueued Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_rules [ 1394.891685] env[65136]: INFO networking_nsxv3.common.synchronization [req-2202e3b6-9edd-4cd5-bb6b-7ca5591f3228 req-eab7eae9-5809-419c-a638-5549a494353f service nova] Enqueued Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_members [ 1394.892081] env[65136]: INFO networking_nsxv3.common.synchronization [req-2202e3b6-9edd-4cd5-bb6b-7ca5591f3228 req-eab7eae9-5809-419c-a638-5549a494353f service nova] Enqueued Resource ID: 2daf272f-0f94-4123-8833-cd1b0803fe27 with Priority: HIGHEST for action port [ 1394.893304] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_rules [ 1394.893525] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_members [ 1394.893701] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2daf272f-0f94-4123-8833-cd1b0803fe27 with Priority: HIGHEST for action port [ 1394.894144] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.894384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.894455] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.894753] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.894932] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.896138] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.896303] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.897115] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-2daf272f-0f94-4123-8833-cd1b0803fe27 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1394.897379] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1394.897710] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1394.897911] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1394.898047] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2daf272f-0f94-4123-8833-cd1b0803fe27',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.399841] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.400080] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.400472] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2daf272f-0f94-4123-8833-cd1b0803fe27 with status ACTIVE [ 1395.400713] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.400861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.400935] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.401252] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.401588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.401588] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.401588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.401588] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.401752] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.401790] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.401968] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.402187] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.402187] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.402288] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.402330] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.402417] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2daf272f-0f94-4123-8833-cd1b0803fe27 is going to be updated. [ 1395.423134] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.423134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.423134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.423134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.423134] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.423473] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.596058] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: SUCCESS [ 1395.596277] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b deletion is rescheduled due to dependency. [ 1395.596361] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.596910] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.597189] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.597421] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.597541] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.597624] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.597776] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.597852] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.597951] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.100584] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.604023] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1397.106552] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.106897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.106897] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.106981] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.107094] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.107197] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b is going to be updated. [ 1397.134216] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1397.134971] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1397.134971] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1397.134971] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1397.134971] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1397.143646] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: IN_PROGRESS for 2s [ 1399.154640] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: SUCCESS [ 1399.155027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.155027] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.155223] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.155414] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.155530] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.155597] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.155748] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.155831] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.155915] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.156015] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.658371] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.894967] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1399.894967] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1400.161478] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4fd8792-0051-494d-99b4-51e73bc1148b: rpc.has_security_group_logging(os_id): False [ 1400.178723] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.178996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.178996] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.179237] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.179359] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.179658] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.179784] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.179861] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.180054] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.180151] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.180245] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b is going to be updated. [ 1400.234960] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.235205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.235205] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.235403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.235551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.260032] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: IN_PROGRESS for 2s [ 1402.281146] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: SUCCESS [ 1402.281591] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.895960] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1404.896452] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1409.897375] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1409.897728] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1414.898854] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1414.899264] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1419.900576] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1419.900939] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1424.901769] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1424.901769] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1429.903079] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1429.903079] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1434.904408] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1434.904855] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1439.905878] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1439.906272] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1444.906895] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1444.907285] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1449.908439] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1449.908850] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1454.909665] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1454.910049] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1459.911156] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.911506] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1464.912302] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.912676] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.120813] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock network-298 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.121146] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "network-298" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.121183] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "network-298" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.121422] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "network-298" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.121674] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.121836] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.121940] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.122350] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.122507] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.122762] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1466.122887] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] NeedRegenerationException {{(pid=65136) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1466.122996] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] no value, waiting for create lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1466.123117] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] value creation lock acquired {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1466.123229] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] No value present for key: 'zone-id' {{(pid=65136) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1466.123334] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Calling creation function for not-yet-present value {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1466.123464] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1466.151302] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1466.151467] env[65136]: DEBUG dogpile.cache.region [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65136) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1466.151592] env[65136]: DEBUG dogpile.lock [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Released creation lock {{(pid=65136) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1466.151766] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "network-298" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.152093] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock port-2daf272f-0f94-4123-8833-cd1b0803fe27 taken with stack trace [, , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.152272] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.152392] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.152647] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.152796] env[65136]: DEBUG networking_nsxv3.api.rpc [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2daf272f-0f94-4123-8833-cd1b0803fe27',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1466.656119] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.656355] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.656355] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.656583] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.656731] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.657054] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.657327] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.657327] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.657552] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.657687] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.658019] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.658186] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.658304] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.658510] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.658645] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.658787] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Resource: SegmentPort with ID: 2daf272f-0f94-4123-8833-cd1b0803fe27 is going to be updated. [ 1466.679414] env[65136]: DEBUG networking_nsxv3.common.locking [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1466.679614] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1466.679760] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1466.679967] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1466.680172] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1466.680392] env[65136]: DEBUG oslo_concurrency.lockutils [None req-1f15f9ee-5f35-48f0-9aa8-1fc60e4bd580 None None] Releasing lock "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.368119] env[65136]: INFO networking_nsxv3.common.synchronization [req-2206e02e-1330-41b3-bc81-be5a420ab967 req-34d717f0-8360-4324-baa3-f8fbea1acf26 service nova] Enqueued Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_rules [ 1467.368415] env[65136]: INFO networking_nsxv3.common.synchronization [req-2206e02e-1330-41b3-bc81-be5a420ab967 req-34d717f0-8360-4324-baa3-f8fbea1acf26 service nova] Enqueued Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_members [ 1467.368515] env[65136]: INFO networking_nsxv3.common.synchronization [req-2206e02e-1330-41b3-bc81-be5a420ab967 req-34d717f0-8360-4324-baa3-f8fbea1acf26 service nova] Enqueued Resource ID: 2daf272f-0f94-4123-8833-cd1b0803fe27 with Priority: HIGHEST for action port [ 1467.368670] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_rules [ 1467.368802] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_members [ 1467.368902] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2daf272f-0f94-4123-8833-cd1b0803fe27 with Priority: HIGHEST for action port [ 1467.369496] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.369622] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.369724] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.369884] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.369965] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.371418] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.371418] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.371530] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.371641] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.371788] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.371898] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.371944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.372097] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.373201] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.373201] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.373201] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock port-2daf272f-0f94-4123-8833-cd1b0803fe27 taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.373201] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.373201] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.373825] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.373825] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2daf272f-0f94-4123-8833-cd1b0803fe27',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.875555] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.875755] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.875905] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1467.876807] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2daf272f-0f94-4123-8833-cd1b0803fe27 with status ACTIVE [ 1467.877442] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.877442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.877442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.877442] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.877685] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.877685] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.877763] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.878353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.878353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.878353] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.878353] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.878657] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.878657] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.878657] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.878657] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.878835] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2daf272f-0f94-4123-8833-cd1b0803fe27 is going to be updated. [ 1467.901400] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1467.901623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1467.901623] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1467.901808] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1467.901944] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1467.902119] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2daf272f-0f94-4123-8833-cd1b0803fe27" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.380495] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1468.883115] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.883336] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.883385] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.883638] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.883779] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.884030] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b is going to be updated. [ 1468.917793] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1468.918080] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1468.918080] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1468.918245] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1468.918392] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1468.928655] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: IN_PROGRESS for 2s [ 1470.940073] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: SUCCESS [ 1470.940517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.940517] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.940665] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.940843] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1470.940964] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1470.941058] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1470.941185] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1470.941261] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.941344] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1470.941435] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1471.443907] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1471.946486] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4fd8792-0051-494d-99b4-51e73bc1148b: rpc.has_security_group_logging(os_id): False [ 1471.964379] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.964530] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.964601] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.964892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.964892] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.965224] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.965318] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.965383] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.965551] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.965635] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.965724] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b is going to be updated. [ 1472.027224] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.027495] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.027495] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.027688] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.027807] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.049289] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: IN_PROGRESS for 2s [ 1472.370016] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1472.370198] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1474.066989] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: SUCCESS [ 1474.067403] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.370996] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1477.371502] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1482.372346] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1482.372346] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1485.685825] env[65136]: INFO networking_nsxv3.common.synchronization [req-de792106-912b-453c-9994-8497725704be req-8a5227db-0dec-4657-a906-c9e4548a4721 tempest-ServerActionsTestOtherB-2006431978 tempest-ServerActionsTestOtherB-2006431978-project-member] Enqueued Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_members [ 1485.686397] env[65136]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4fd8792-0051-494d-99b4-51e73bc1148b with Priority: HIGHEST for action security_group_members [ 1485.686701] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4fd8792-0051-494d-99b4-51e73bc1148b taken with stack trace [, , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.686847] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.686914] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.687253] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.687253] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1485.687421] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1485.687421] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1485.688064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1485.688064] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1485.688064] env[65136]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4fd8792-0051-494d-99b4-51e73bc1148b',) {} {{(pid=65136) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1486.190297] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.190552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.190552] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.190719] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.190798] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.190992] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.191103] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.191155] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.191306] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.191384] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.191505] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b is going to be updated. [ 1486.219292] env[65136]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65136) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1486.219534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1486.219534] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1486.219705] env[65136]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1486.219850] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1486.227663] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: IN_PROGRESS for 2s [ 1488.241900] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: IN_PROGRESS for 4s [ 1490.257035] env[65136]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4fd8792-0051-494d-99b4-51e73bc1148b in Status: SUCCESS [ 1490.257035] env[65136]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4fd8792-0051-494d-99b4-51e73bc1148b deletion is rescheduled due to dependency. [ 1490.257413] env[65136]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4fd8792-0051-494d-99b4-51e73bc1148b" {{(pid=65136) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1490.687447] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1490.687575] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1495.688929] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1495.688929] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1496.279392] env[65136]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1496.279392] env[65136]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-0b0555e2-6e2b-4fb3-ac5f-12d4586e5717 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1500.690071] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1500.690599] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1505.691328] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1505.691761] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1510.692449] env[65136]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1510.692976] env[65136]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0